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A  DISCRETE  APPROXIMATION  FRAMEWORK  FOR  HEREDITARY  SYSTEMS 

Abstract 

■ i 

A  discrete  approximation  framework  for  initial-value  problems  involving 
certain  classes  of  linear  functional  differential  equations  (FDE)  of  the  retarded 
type  is  constructed.  An  equivalence  between  the  FDE  and  abstract  evolution 
equations  (AEE)  in  an  appropriately  chosen  Hilbert  space  is  established.  This 
equivalence  is  then  employed  in  the  development  of  discrete  approximation  schemes 
in  which  the  infinite-dimensional  AEE  is  replaced  by  a  finite-dimensional  system 
of  difference  equations.  Convergence  and  rates  of  convergence  are  demonstrated 
via  the  properties  of  rational  functions  with  operator  arguments  and  both  classical 
and  recent  results  from  linear  semigroup  theory.  TVo  examples  of  families  of 
approximation  schemes  which  are  included  in  the  general  framework  and  which  may 
be  implemented  directly  on  high-speed  computing  machines  are  developed.  A 
numerical  study  of  examples  which  illustrates  the  application  and  feasibility 
of  the  approximation  techniques  in  a  variety  of  problems  together  with  a  summary 
and  analysis  of  the  numerical  results  are  also  included. 
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1.  Introduction 


The  focus  of  this  investigation  is  the  construction  of  a  general  abstract 
approximation  framework  for  certain  classes  of  linear  retarded  functional  dif¬ 
ferential  equations  (FDE) .  The  methods  included  in  the  framework  will  have  a 
sound  theoretical  basis  for  convergence,  and  will  be  designed  with  the  intent  of 
application  to  the  solution  of  optimal  control  and  parameter  identification 
problems  governed  by  FDE.  The  work  presented  below  is  concerned  with  approximate 
integration  methods  for  FDE,  while  the  results  dealing  with  the  application  of 
the  schemes  to  the  optimal  control  and  parameter  identification  problems  will  be 
discussed  elsewhere.  We  begin  by  calling  upon  the  results  of  Banks  and  Burns 
[3],  [4],  among  others,  to  establish  the  equivalence  of  solutions  to  certain 
classes  of  FDE  of  particular  interest  and  the  solutions  of  corresponding  abstract 
ordinary  differential  equations,  also  known  as  abstract  evolution  equations  (AEE) 
set  in  an  appropriately  chosen  Hilbert  space.  We  then  proceed  to  develop 
general  approximation  schemes  for  the  solutions  to  the  homogeneous  AEE  which 
in  turn,  via  the  equivalence  described  above,  provide  approximate  solutions  to 
the  FDE.  Using  approximation  techniques  for  semigroups  of  bounded  linear 
operators  on  abstract  spaces,  both  classical  and  recently  published  results, 
we  are  able  to  characterize  the  convergence  and  rates  of  convergence  for  rich 
classes  of  these  schemes.  In  addition,  two  particular  families  of  approximation 
schemes  included  in  the  general  framework  are  developed  and  studied  in  detail. 

The  approximation  framework  for  the  homogeneous  initial-value  problem  is  then 
extended  to  include  schemes  applicable  to  the  non-homogeneous  problem  as  well. 

We  conclude  with  a  discussion  of  numerical  results  obtained  by  actually  imple¬ 
menting  and  testing  these  schemes  on  a  wide  variety  of  hereditary  systems. 


The  idea  of  constructing  approximate  solutions  to  differential  equations 
set  in  infinite-dimensional  spaces,  in  particular  FDE  and  parabolic  and  hyper¬ 
bolic  partial  differential  equations  via  approximations  to  the  solutions  of 
equivalent  AEE,  has  been  considered  by  many  authors.  Historically,  the  well- 
known  Lax  equivalence  theorem  (cf.  Richtmyer  and  Horton  131])  for  the  homogen¬ 
eous  case,  and  Thompson's  [35]  subsequent  extension  of  their  results  to  the 
non-homogeneous  and  quasi-linear  problems,  can  be  considered  to  be  the  forerun¬ 
ners  of  most  investigations  in  this  direction.  More  recently,  in  the  partic¬ 
ular  case  of  FOE,  a  rather  extensive  formulation  for  an  approximation  framework 
has  been  developed  by  Banks  and  Burns  [3].  The  latter  treatment  considers  a 
state  variable  approximation  exclusively  as  part  of  a  two-step  process  through 
which  the  final  approximating  solution  is  obtained.  That  is  to  say,  the  AEE, 
an  ordinary  differential  equation  in  an  infinite-dimensional  abstract  space 
characterized  by  an  unbounded  operator  on  the  right-hand  side,  is  approximated 
by  a  sequence  of  systems  of  ordinary  differential  equations  defined  on  finite¬ 
dimensional  approximating  subspaces.  These  systems  of  ODE  of  successively 
higher  dimension  must  then  in  turn  be  solved  numerically  via  any  one  of  a  number 
of  classical  approximate  integration  techniques.  The  schemes  discussed  here, 
however,  approximate  the  AEE  by  a  sequence  of  systems  of  discrete  difference 
equations  of  successively  higher  dimension.  This  represents  a  simultaneous 
approximation  in  both  the  state  and  the  time  variable  which  is  readily  programmed 
in  a  single  step.  Recently,  Reber  [28],  [29],  in  considering  these  ideas  for  linear 
non-autonomous  systems  (i.e.  systems  with  coefficients  that  vary  in  time),  has 
demonstrated  sub-linear  convergence  for  a  scheme  employing  finite-diffefence- 
like  approximations  in  both  the  state  and  the  time  variables.  In  the  case  of 
an  autonomous  system,  his  work  becomes  a  special  case  of  the  general  approxima- 


tion  framework  constructed  in  the  sequel.  Furthermore,  the  abstract  formulation 
to  be  discussed  below  allows  one  to  consider  state  and  time  variable  approxima¬ 
tions  of  varying  design  and  arbitrary  order  of  convergence  independently.  An 
extensive  bibliography  and  survey  of  the  literature  through  1976  concerned  with 
the  approximation  of  solutions  to  FDE  (and,  in  some  cases,  the  associated  optimal 
control  problem)  via  techniques  of  the  type  discussed  above  can  be  found  in  [4] . 
Finally,  a  rather  broad  theory,  somewhat  more  general  in  nature  yet  less 
attuned  toward  practical  computation  than  the  research  to  follow,  can  be  found 
in  a  recent  paper  by  Hersh  and  Kato  (15J .  Many  of  our  results  are  closely 
related  to  the  ideas  of  the  Hersh-Kato  treatment. 

The  notation  employed  here  is  for  the  most  part  standard.  For  1  <_  p  <  a 
closed  interval  I  in  R  and  a  Banach  space  X,  the  symbol  L^dfX)  denotes  the 
Banach  space  whose  elements  consist  of  equivalence  classes  of  strongly 

Lebesgue-measurable  functions  f:  I  -*■  X  for  which  /|  f  |P  <  »  and  which  is 

I  X 

endowed  with  the  usual  L  norm  | f  |  ■  {/|f|P)1/,p.  The  symbol  C(I;X)  denotes 

P  pi* 

the  Banach  space  of  continuous  functions  from  I  into  X  together  with  the  usual 

supremum  norm.  In  the  case  that  X  ■  Rn,  where  n  is  the  dimension  of  the  FDE 

system  under  investigation,  the  above  notations  are  foreshortened  to  L  (I) 

P 

and  C(X)  respectively.  The  syntool  <•#•>  represents  the  standard  inner 

L2 

product  on  the  Hilbert  space  L_(I)  given  by  <f,g>-  *  /  fg.  La(I)  (with  the 

2  2  1 

standard  L  norm)  denotes  the  Banach  space  of  all  real-valued  equivalence 

classes  of  functions  which  are  essentially  bounded  on  I,  while  the  notation 

cNl)  stands  for  the  space  of  all  Rn-valued  continuous  functions  defined  on 

I  whose  first  k  derivatives  are  continuous.  M(i)  represents  the  measurable 

functions  from  I  into  Rn  while  the  Banach  spaces  (I»Rn)  of  Rn-valued 

P 

absolutely  continuous  functions  possessing  j-1  absolutely  continuous  deriva¬ 
tives  and  jth  derivatives  that  are  in  L^(I)  are  denoted  simply  by  W^d) .  For 


4. 


Banach  spaces  X  and  Y,  the  synbols  i?(X,Y)  and i#(X)  denote  the  spaces  of 
all  bounded  linear  operators  from  X  into  Y  and  X  into  X  respectively.  The 
spaces  Rn  and  iff'  ^ ,  the  space  of  all  n  *  n  matrices,  are  endowed  with  the 
euclidean  and  spectral  norms,  respectively.  The  norm  of  an  element  x  con¬ 
tained  in  a  normed  linear  space  X  is  denoted  by  |x|x,  or  more  simply  by  |x| 
in  the  case  that  the  intended  space  may  be  inferred  from  the  context  of  the 
statement.  Similarly,  the  norm  of  a  bounded  linear  operator  TG.#(X,Y) 
is  denoted  simply  by  |  T  |  in  the  case  that  the  operator  norm  in  question  is 
that  one  which  is  induced  by  the  standard  norms  on  the  spaces  X  and  Y.  If 
T  €  i9(X) ,  the  notation  |  T |  will  also  on  occasion  be  used.  The  symbol  I 

is  used  to  represent  the  identity  operator.  No  further  clarification  is 
provided  if  the  space  upon  which  it  operates  can  be  determined  from  the  con¬ 
text  of  its  usage.  The  standard  notations  o(5T,  are  employed  to 

represent  the  spectrum,  point  spectrum  and  resolvent  set  in  the  complex  plane 
C  of  a  linear  operator^-,  while  the  symbols and  denote  its 

domain  and  range.  For  AG  p (^1  ,  the  symbol  R(A ;J7~)  denotes  the  resolvent  of 
^  &-\I)  .  The  positive  integers  n,  v,  p  and  positive  numbers  T  and  r  to 

be  defined  in  the  next  section  are  assumed  to  be  fixed  throughout.  For  any 
function  x  of  one  real  variable  we  use  both  x  and  Ox  to  stand  for  the  deri¬ 
vative  of  x  with  respect  to  that  variable.  As  is  commonly  the  case  in  papers 
concerning  retarded  functional  differential  equations,  for  an  Revalued 
measurable  function  s  x(s)  ,  the  notation  x^  denotes  the  function  in 
M  <-r,0)  given  by  xt(0)  *  x(t+0),  -r  <_  0  <_  0.  For  a  rational  function 
C(z)  «  P(z)/Q<z)  defined  for  z  G  c,  the  symbol  deg  C(z)  denotes  that  integer 
given  by  deg  P  -  deg  Q,  where  deg  P  and  deg  Q  represent  the  respective  degrees 
of  P'  and  Q  as  polynomials  in  z . 
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2.  Equivalence  of  FDE  and  AEE 

He  state  precisely  the  FDE  initial-value  problems  for  which  approximate 
solutions  are  sought  and  describe  their  equivalent  formulations  as  correspond 
ing  AEE  initial-value  problems  set  in  an  abstract  function  space. 

Consider  the  initial-value  problem  given  by 


(2.1)  x(t)  =  L(xt)  +  f(t),  te  10, T] 


(2.2)  x(0)  *  n,  xQ  =  * 


where  nG  Rn,  $€  L2(-r,0)  and  f  G  L2(0,T).  We  shall  assume  that  the  linear 
operator  L:  L2(-r,0)  -*■  Rn  is  of  the  form 


(2.3) 


L(4>) 


0 

Aj4»(-Tj)  +  J  D(e)$(0)d0 

-r 


where  A_.£  <Sm,  j  =  0,  1,  2,  ...,  v,  dG  L2(  f_r'01  f  *^nn)  and  0  =  T0  <  T1  < 

...  <  xv  ■  r.  Strictly  speaking,  the  expression  for  L  given  by  (2.3)  is  not 
well-defined  for  all  $  £  L2(-r,0)  in  that  point  evaluations  of  $  are  required. 
However,  since  our  primary  concern  is  the  solution  of  the  initial-value  prob¬ 
lem  (2.1),  (2.2),  we  need  only  consider  instances  of  L(xfc)  appearing 
beneath  an  integral  sign.  More  precisely,  a  solution  of  the  initial-value 
problem  (2.1),  (2.2)  is  a  function  x  €E  L2(-r,T)  such  that  t  -+  x(t)  is 
absolutely  continuous  on  (0,T),  x(0)  ■  n,  xQ  =  $  and 

t  t 

(2.4)  x(t)  ■  n  +  |  L(xff)do  +  |  f(o)da,  t  G  [0,T] . 

0  0 


xo€  L2(-r,0)  for  each  oG  (0,TJ  implies  that  the  mapping  a  ■*  L(x0)  is  in 


6. 


L2(0,T).  Thus  the  expression  for  x(t)  given  by  (2.4)  is  well-defined. 
Employing  standard  arguments,  the  following  lemma  may  be  established. 

2.5.  Lemma.  There  exists  a  unique  solution  to  the  initial-value  problem 

(2.1),  (2.2).  Moreover,  the  solution  depends  continuously  upon  the 

initial  data  and  the  non-homogeneous  perturbation.  That  is  to  say,  if 

x^ft)  denotes  the  unique  solution  to  the  non-homogenous  FOE  x(t)  = 

L(x^)  +  fk<t)  with  initial  conditions  x(0)  =  nk>  x0  “  where  nk  ■*  n  in 

Rn,  4>k  <l>  in  L2(-r,0)  and  f^  f  in  L2(0,T)  ,  then  we  have  that 

sup  |x^(t)-x(t)  |  -*•  0  as  k  ->  09  where  x(t)  is  the  unique  solution  of  the 
t  e[0,T]  K 

initial-value  problem  given  by  (2.1),  (2.2). 


2.6.  Remark ♦  Linear  homogeneous  FDE  with  right-hand  sides  of  the  form 
given  by  the  expression  in  (2.3)  are  not  the  most  general  to  which  the 
equivalence  and  approximation  results  to  be  established  can  be  applied. 

However,  it  is  noted  in  [6]  end  113]  that  this  form  is  of  sufficient  generality  to 
include  all  linear  homogeneous  autonomous  FDE  commonly  arising  in  practical 
applications.  The  details  of  establishing  the  equivalence  for  the  FDE 
initial-value  problem  (2.1),  (2.2)  under  less  restrictive  hypotheses  are 
discussed  iri  [  3  ] ,  [  4  ] . 


Following  Borisovic  and  Turbabin  ( 9  ] ,  and  countless  other  authors  working 
with  retarded  functional  differential  equations,  we  choose  the  Hilbert 
space  Z  =  Rn  x  L2(-r,0)  with  inner  product 


<(n1,*1),(n2,*2)>z  -  <VV»  +  kWl, 

R  • 


as  the  space  upon  which  the  corresponding  AEE  will  be  defined.  In  the  light 
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of  the  existence,  uniqueness  and  continuous  dependence  results  stated  in 
Lemma  2.5,  one  can  define  a  family  of  solution  operators  on  the  space  Z  assoc¬ 
iated  with  the  homogeneous  form  of  the  initial-value  problem  (2.1),  (2.2). 
Indeed,  for  t£  [0,T],  let  S(t):  Z  -*•  Z  be  given  by 

S(t) ($,n)  *  (x(t) ,xfc) 

where  x  is  the  unique  solution  of  (2.1),  (2.2)  with  f  =  0.  The  pair  (x(t) ,x^) 
will  on  occasion  be  referred  to  as  the  state  or  state  variable  of  the  system. 
Since  Lemma  2.5  is  valid  for  all  T  >  0,  the  family  {S(t)s  t  ^  0}  forms  a 
semigroup  of  bounded  linear  operators  on  Z.  Standard  techniques  [4]  can 
now  be  used  to  calculate  the  closed  densely  defined  infinitesimal  generator 
_Q^of  {S  (t) :  t  ^  0}  together  with  its  domain  of  definition.  They  are  given  by 

_Q^(n,«t>)  -  (L(<f>M) 

for  all  (n,4»)6  2>W)  =  { (n,$)G  Z:  n=*4>(0) ,  ♦Gw^l-rrO)}. 

For  purpose  of  reference,  we  state  certain  properties  of  the  ^  semigroup 
of  operators  (S(t)  :  t  ^  0}  and  its  infinitesimal  generator that  are  used  in 
the  discussion  below.  The  verification  of  these  results  may  be  found  in  any 
standard  reference  on  linear  semigroup  theory.  In  particular,  [1],  [18],  [19], 
[26]  and  [38]  are  adequate  in  this  regard. 

00 

(1)  is  dense  in  Z.  in  particular,  <^(Q^n)  is  dense  in  Z  for 
n=l 

each  n  *  1 ,  2 ,  ...  . 

(2)  There  exist  positive  constants  5  and  M  such  that  a  Lflrt  =  tfCOrtC 
{XGCtRe  A<B>  and,  moreover,  the  resolvent  operator  R(X;.Q^)  with  Re  X  >  B 


satisfies  the  condition 


8. 

(2.7)  |R(X;jaf)n|z=  |U*’-XI>-n|z<  M(Re  X-B)"n 

for  all  n  >_  1.  This  in  turn  implies  that 

|s(t)  |z<  Me8t. 

W'e  adopt  the  notation  of  Kato  [18]  and  let  the  symbol  G(M,8)  denote  the 
set  of  all  closed,  densely  defined  operators  that  satisfy  a  condition  like 
(2.7)  on  the  respective  spaces  upon  which  they  are  defined.  In  addition, 
we  shall  also,  on  occasion,  have  reason  to  consider  the  set  of  all  closed, 
densely  defined  linear  operators  ^  whose  resolvent  sets  p(_^~)  contain  not 
only  the  half-plane  {X€:C:  Re  X>8},  but  a  sector  of  the  complex  plane, 

(X  g  C:  (?rg  X-81*^  +  fi  for  some  w  >  0,  and  whose  resolvent  operators, 

R(X;_^~),  satisfy  the  stronger,  somewhat  more  restrictive  condition 

|R(X;_^)n|  =  |(^-Xl)'n|  <  M|X-6|"n 

for  all  X  €  {XGCs  |arg  X— 6 1  <  ^+w),  n  =  1,2,...  .  We  denote  this  set  of 
operators  by  the  symbol  H(u>,8,M)  .  We  note  that  if  H(u,8,M)  it  is  the 
infinitesimal  generator  of  (u(t)},  a  quasi-bounded  semigroup  of  operators 
(i.e.  |u(t)|  <_  Me^S  ,  holomorphic  in  t  for  t  contained  in  a  sector  of  the 
complex  plane  (cf.  Kato  [ 18l ) • 

A  linear  operator  with  domain  dense  in  a  Hilbert  space  H  is  said 
to  be  dissipative  if 

Re  <.^x,x>H  <_  0  for 

It  can  be  shown  (cf.  Krein  [19])  that  if  there  exist  a  constant  8  and  an  inner 
product  [ • , • Jjj  defined  on  H  which  generates  a  topology  equivalent  to  the 


9. 


standard  inner  product  topology  on  H,  then  the  conditions  _^~-0l  dissipative 
with  respect  to  the  I  * ,  -  J  inner  product  (i.e.  [_^x,x]u  <  0[x,x]„,  xG^CSn) 
and  I))  =  H  for  any  X  with  Re  X  >  0  are  necessary  and  sufficient  for 

,^6  G(M,0)  .  Furthermore,  01  dissipeftive  implies  (see  [19])  that 
o (JP)  C  {XGC:Re  X<0}.  Thus  if  H  is  finite-dimensional,  .^G  G(M,0)  if 
and  only  if  C5T-0I)  is  dissipative. 

We  now  construct  an  inner  product  on  Z,  <•,•>  ,  that  generates  an  equival¬ 
ent  topology  to  the  standard  inner  product  topology  on  Z  and  for  which  there 
exists  a  constant  0  such  that  <-Qtfz,z>  <  0<z,z>  for  all  z  contained  in  &S& . 

g  -  g 

■Hie  inner  product  we  construct  is  essentially  the  same  as  those  defined  in 
[61,  [29]  and  [30]  for  a  similar  purpose. 

Let  the  step  function  g  defined  on  l-r,0)  be  given  by 


g(0) 


v 

g..  *  1  +  I  |  A .  I  for  0  G  [-T  ,-T  )  ,  j  =  1,2,...,  V 

•  i*j  3  3 


Then,  for  (n,$)  and  (C,<l>)  G  Z,  we  define 


<(»!,♦), (c,*)>g  =  n  c  +  I  ♦(e)iH0)g(6)de 


-r 


T 

=  n  5  + 


I  9j  < 

j=i  3 


«H0)^(0)d0 


-T  . 

3 


and 


|  (n,4»)  1^  **  <(n,$)  ,(n,$)>g. 


10. 


Clearly 


Mz  £  H„  i  d  *  l  I  Aj»1/2 


< 

•g  - 


j  =  l 


Thus  the  topology  generated  by  <•»•>  on  Z  is  equivalent  to  the  standard 
inner  product  topology  on  Z.  Furthermore,  using  standard  arguments  (cf.  [6 j , 
[29],  [33]),  we  have  for  $  =  (<M0)  A)  G  , 


<(L(<t>)  J)  ,  (<f>(0)  ,*)> 

g 


V 


A.* 


(-T.) 

3 


+ 


0 

j  D(0)  $  (0)  d0 , 4>  (0) 
-r 


v  f  j_1 

+  l  g,  $(0)<M6)d0  <  0«J>,$> 
j=l  J  iT  9 

j 


where  0  =  (1  +  Ij.0lAjl  +  lDlIl  >  * 

Turning  our  attention  to  establishing  an  equivalence  result  for  the  non- 
homogeneous  initial-value  problem  (2.1),  (2.2),  for  zQ  =  (n , 4> )  G  Z  and 
f  G  I«2(0,T),  let  z:  [0 ,T]  Z  be  given  by  the  expression 

t 

(2.8)  zlt)  =  S(t)zQ  +  js(t-o) (f(0)  ,0)do  ,  t  G  [0,T] , 

0 

where  o  denotes  the  zero  function  in  L2(-r,0). 

2.9.  Lemma.  For  z  as  in  (2.8)  and  x  the  unique  solution  of  the  non-homogeneous 
initial-value  problem  (2.1),  (2.2)  we  have  the  strong  equivalence  of  solutions 
given  by 


11. 


(2.10)  z(t)  =  (x(t),xfc). 

The  complete  proof  of  Lemma  2.9  may  be  found  in  [3].  However,  it  can  be  sum¬ 
marized  as  follows.  The  equivalence  stated  in  (2.10)  is  easily  verified  for 
the  case  of  f  G  (0,T)  and  zQ  £  &(&/)  via  standard  results  from  linear 
semigroup  theory  [18].  An  application  of  the  facts  that  C^fOjT)  is  dense  in 
L2(0,T)  and  is  dense  in  Z,  together  with  the  uniqueness  and  continuous 

dependence  properties  of  both  x(t)  and  z(t) ,  are  sufficient  to  conclude  that 
the  desired  strong  equivalence  of  solutions  obtains  for  all  f  €  L2(0,T)  and 
zQe  z. 

3.  Preliminary  Definitions  and  Basic  Results 

We  make  the  following  definitions  that  will  prove  useful  in  our  discussions 
below  in  regard  to  the  formulation  of  an  approximation  framework  for  the  homo¬ 
geneous  FDE  initial-value  problem  given  by 


(3.1)  x(.t)  =  L(xt),  t€  [0,T], 

(3.2)  x(0)  =  n,  xQ  ■ 


3.3  Definition.  Let  (Z  }  denote  a  sequence  of  approximating  finite¬ 
dimensional  subspaces  of  Z  [ 6  ]  defined  by 


span{$’ 


.(U 

$  N  } 


A  /  4) 

where  €  Z,  j  ■  1,  2,  . ..,  k„.  Then  for  each  N  **  1,  2,  ...,  the  4- tuple 

N  N 


simply  a  DAS,  for  the  Cauchy  problem  (.3. 1) ,  (.3.2)  if 
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(1)  (V  <‘**>N)  is  a  finite-dimensional  approximating  Hilbert  space 
defined  by  the  relations 


N 


cN(ZN) 


and 


where  pN  represents  an  algebraic  isomorphism  mapping  ZN  onto  Z  .  (As  an 

N  k 

N 

example,  one  possible  construction  for  Z%t  would  be  to  choose  *=  R  and 

N  N 

M 

a  as  the  canonical  coordinate  map  from  the  finite-dimensional  subspace  Z 

N 

onto  R  .)  We  note  that  with  the  inner  product  on  Z  defined  as  above,  a 

N 

actually  represents  an  isometric  mapping  of  Z  onto  Z  . 

N 

(2)  Z  -*■  Z„  together  with  its  right  inverse  ir  1 :  Z  -+■  Z  are  projection- 

N  N  N  N 

and  embedding-like  mappings  respectively  defined  by 


N' 

'n  -  °  Pu' 


a  <-N  ~N,X 

where  PN  is  the  orthogonal  projection  of  Z  onto  Z  along  (Z  )  . 

(3)  -flO  Z„  Z„  is  a  bounded  linear  operator. 

N  N  N 

(4)  C(z)  is  a  rational  function  of  the  complex  variable  z. 


We  make  the  standing  assumption  that  T  =  pr,  p  an  integer  greater  than 

zero,  and  partition  the  interval  [0,T]  into  PN  subintervals  of  equal  length 

defined  by  the  nodal  points  t£  «  kr/N,  k  =  0,  1,  ...»  pN.  That  essentially 

no  loss  of  generality  is  incurred  by  restricting  T  to  be  an  integral  multiple 

of  the  maximum  delay  in  the  problem,  r,  is  discussed  in  Reber  [29  ,  Section 

8] .  it  is  our  desire  to  construct  the  Discrete  Approximation  Scheme 

{Z„,ir„,J3^1,C(z) }  in  a  manner  that  will  guarantee  that  if 
N  N  N 
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(a)  ir^z  is,  in  some  sense,  an  approximation  to  z  for  each  z  £  z 

(b)  Ja^ir^z  is,  in  some  sense,  an  approximation  to  J&z  for  each  z  in 
a  sufficiently  large  subset  of  ^(J2^) 

2 

(c)  C(z)  is,  in  some  sense,  an  approximation  to  e  for  z  €:  C  suffic¬ 


iently  small 


then  the  sequence  of  vectors  {z^}^Q  contained  in  Z^  and  generated  by  the 

discrete  semigroup  of  operators  {C (— Sif  )  }  (cf.  Kato  [18])  according  to  the 

N  N 


recurrence 


N 

Z0  _  W 


N  ,r  . , 

Zk+1  =  CW,Zk' 


k  =  0,1,2, .. . , pN-1, 


will  in  some  sense  approximate 


/.A 

*<V 


*0  -  s(,k>V 


k  =  0,1,2, 


It  is  further  desired  that  {z^}^Q  provide  an  approximation  (x^}^0  to 
{x(15»El0,  the  true  soluti°n  the  FDE  initial-value  problem  (3.1),  (3.2) 
evaluated  at  the  node  points.  Making  these  ideas  precise  and  demonstrating 
that  they  can  indeed  be  realized  are  the  concerns  of  the  definitions  and 
results  that  follow. 


3-4-  Definition.  The  Discrete  Approximation  Scheme  {Z„,ir  ,  Jj/  ,c(z)  }  will 

N  N  N 

be  said  to  be  factor  stable  if  the  infinite  set.  of  operators  on  Z^  given  by 


C(— erf )  k 


k  ■  0,1,2, ... ,pN  . 


is  uniformly  bounded  in  N  for  all  N  sufficiently  large. 
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The  fact  that  C(z)  =  N(z)/D(z)  is  a  rational  function 

implies  that  the  evaluation  of  for  each  N  will  require  the  invertibil- 

N  N 

ity  of  the  operators  D(£j3^t) .  Sufficient  conditions  which  can  be  satisfied  by 
the  and  C(z)  which  will  guarantee  the  existence  of  this  inverse  will  be 
provided  in  the  next  section.  For  the  present,  however,  the  operators 
will  be  referred  to  with  the  implicit  assumption  that  D  (— 
exists  for  all  N  sufficiently  large. 

3.5.  •  Definition.  The  Discrete  Approximation  Scheme  {Z^,^, fl^N,C(z) }  will 
be  said  to  be  factor  convergent  as  an  approximation  to  the  initial-value 
problem'  (3.1),  (3.2)  if  for  each  zQE  Z,  given  e  >  0,  there  exists  an  N  * 

N ( e , zQ)  such  that 

Vo-V(<’*oIn  *  c  •  k  -  O'1’2 . 


for  all  N  >  N. 


The  next  definition  is  a  precise  statement  of  what  is  intended  when  it 


is  said  that  it„z  is  an  approximation  to  z  for  each  z  E  Z . 
N 


3.6.  Definition.  A  Discrete  Approximation  Scheme  {Z^,  1^,-0^, C (z)  }  will 

be  said  to  have  property  (PI)  if  the  mapping  ;  Z  ZN  and  its  right  inverse 

it  1  s  Z„  Z  satisfy  the  condition 
N  N 


tt/it  z  -  z\„  ■*  0  as  N  »  for  each  zG  Z. 
N  N  '  Z 


3.7.  Lemna.  Suppose  {Z„,ir..,jaf..,C(z)  }  is  a  Discrete  Approximation  Scheme 

—  N  N  N 

with  property  (PI)  .  Then  the  mapping  Z  -*■  ZN  and  its  right  inverse 
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it-1:  Z„  Z  satisfy  the  following: 

N  N 

(1)  l\z|N  1  Ulz  each  z 

(2)  |ir"1zN|z  <  |zN|n  for  each  zNG  Z^ 

(3)  lirzL  |z|_  as  N  +  •  for  each  zG  Z. 

N  N  Z 

The  veracity  of  Lemma  3.7  follows  directly  from  the  definitions  of  v  and  it-1. 

N  N 

We  note  that  only-  the  third  proposition  requires  {Z„,it„,jy„,C(z)  }  to  have 

N  N  N 

property  (Pi) . 

3.8.  Definition.  Let  p^;  Z  •+•  Rn,  p^:  Z  -*■  L^t-r,©)  be  the  two  coordinate 
projection  mappings  defined  by  p^(n#$)  ~  n  and  (n,4>)  =  41  respectively  for 
(n,4>)  G  Z. 

That  a  factor  convergent  Discrete  Approximation  Scheme  does  indeed  yield 
an  approximate  solution  to  the  FDE  initial-value  problem  (3.1),  (3.2)  is  veri¬ 
fied  in  the  next  lemma. 


3.9..  Lemma.  Suppose  that  )  is  a  factor  convergent  Discrete 

Approximation  Scheme  with  property  (PI).  Then,  given  e  >  0,  there  exists  an 
N  =  N(e)  such  that  |x(t£)-p1(ir“1z£)'|  n  <  e,  k  =  0,1, ...,pN,  for  all  N  >  N, 
where  the  sequence  in  Z^  is  given  by 


Proof:  Let  e  >  0  be  given.  Then 


Since  (z(t)  :  t€lO,T]}  is  a  compact  subset  of  Z  (being  the  continuous  image  of 


a  compact  subset  of  R)  and  (ZN'  1rN'-Q^'C (z)>  has  been  assumed  to  have  property 

(Pi),  we  may  conclude  that  ir  ^"ir  -*•  1  uniformly  on  {z(t):  t€E[0,T]}  as  N  +  », 

N  N 

Thus  the  first  term  in  the  last  inequality  in  (3.10)  tends  to  zero  as  N 
In  addition,  the  fact  that  (Z„,ir„,  (z)  }  has  been  assumed  to  be  factor 

convergent  implies  that 

for  all  N  sufficiently  large.  Therefore,  it  follows  that 

l*(V-pl(*Nl2k)!n  <  E'  k  = 


for  all  N  sufficiently  large. 
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4.  The  Equivalence  Theorem 

In  this  section  we  state  and  prove  a  theorem  that  provides  necessary 
and  sufficient  conditions  for  the  factor  convergence  of  a  Discrete  Approxima¬ 
tion  Scheme  and  subsequently  yields  estimates  for  the  rate  of  factor  conver¬ 
gence  on  restricted  classes  of  initial  data.  The  sufficient  conditions  are 
such  that  they  are  easily  verified  for  a  wide  variety  of  DAS  that  are  considered 
in  the  sequel.  The  arguments  required  to  prove  this  theorem  rely  heavily  upon 
standard  approximation  results  for  semigroups  of  linear  operators  (cf.  Kato 
[ 181 ) •  These  preliminary  results,  which  have  been  suitably  modified  so  as  to 
allow  for  the  additional  complexity  introduced  by  the  variation  of  the  approx¬ 
imating  spaces,  are  contained  in  Lemmas  4.1,  4.3  and  Theorem  4.4  below. 

In  the  discussions  which  follow,  Z^,  xN,  are  assumed  to  have  been 
constructed  in  accordance  with  the  requirements  specified  in  Definition  3.3. 


4.1  Lemma.  Suppose 

(1)  ^  G(M,8)  for  N  sufficiently  large  (M,B  independent  of  N) ; 

(2)  |  I^nVV^ZC)In  -  0  as  N  ”  for  each  Z0G  V  Where  °1  iS  * 

dense  subset  of  Z  contained  in  » 

(3)  For  HQec  with  Re  \Q  >  8  there  exists  a  dense  subset  of  Z,  X>2, 
such  that  R(X0;jartD2C  D^ . 

Then  it  follows  that 

|  Wao,Q^l£oU  *  °  as  N  -  - 

for  each  zQ€  Z. 


Proof ; 


(4.2)  l  vv(Xo;^)]zoU 

f  |R(A0;J^N)||[J^NVirN^R(X0;-artzOlN 

for  each  zQ  G  .  However,  D2  is  dense  in  Z,  and  the  operators 
lRU0;^N>*N-irNR<A0;J*)) 

are  uniformly  bounded  in  N  for  all  N  sufficiently  large.  Indeed 

lR(X0^N)VV(X0^r)  lN  -  ReT^B  • 


for  all  N  sufficiently  large.  Therefore,  it  follows  that 


V 


'*% 


4.3.  Lemma.  Suppose  _Q^€  G(M,6)  for  all  N  sufficiently  large.  Then  for 
X  €  C  with  Re  X  >  8,  the  operators A£,R(Xj_Q/t)  =  -OC(-Q^„-Xl)  1  are  uniformly 

N  N  N  N 

bounded  in  N  for  all  N  sufficiently  large. 

Proof:  Re  X  >  8  and  E  G(M,8)  imply  that  X  G  p(J3^).  Therefore,  we  have 
I  -  (jafj-xu  (J^-xi)"1  -  J^(ja^-XT)"1  -  X(ja^-xi)-1 

% 

or 

ja^ua^-xn-1  =  i  +  xta^-xi)"1. 


This  implies 


<  1  + 


Mm 

Re  x-e 


for  all  N  sufficiently  large. 


□ 


Theorem  4.4,  to  follow,  is  a  minor  modification  of  a  standard  result  from 
the  theory  of  approximation  for  linear  semigroups  of  operators  generally  attri¬ 
buted  to  Trotter  136] .  The  veracity  of  the  result  can  be  argued  in  a  manner 
similar  to  that  used  by  Kato  in  verifying  Theorem  2.16  in  Chapter  IX  of  [18]. 
The  details  of  the  proof  of  the  result  as  stated  in  Theorem  4.4  can  be  found 

in  [33]. 


4.4  Theorem.  Suppose 
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(1)  jafl,:  Z„  -*■  2„  is  the  infinitesimal  generator  of  the  semigroup 
N  N  N  0 

of  bounded  linear  operators,  {S  (t) :  t>0}  ,  defined  on  2  : 

N  -  —  N 

<2)  z  -*■  z  is  the  infinitesimal  generator  of  the  ^  semi¬ 

group  of  bounded  linear  operators,  {S(t):  t>0},  defined  on  Z, 

such  that 

(1)  _fl^€G(M,&)  for  all  N  sufficiently  large  (M,  fi  independent  of  N) 
N' 

(2)  |  zQlN  4  D  as  N  +  »  for  each  zQ€  0^  where  is  a 

dense  subset  of  Z  contained  in^(£^); 

(3)  There  exists  a  AQ €  C  with  Re  AQ  >  $  and  D2,  a  dense  subset  of 
Z  such  that 

R(Ao;1*0d2  C  Dx. 

Then  I  [S„(t)  n  -*„S  (t)  ]  z_  L  +  0  as  »•>«  for  each  z- 6  Z,  and  moreover  the 
1  N  N  N  UN  U 

convergence  is  uniform  in  t  for  t  E  10, TJ. 


vie  remark  that  if  the  set  is  invariant  under  R(AQfjy)  for  some 
Aq  €  C  with  Re  AQ  >  6,  that  is  RiAgtoDD^  C  D^,  it  suffices  to  choose  D2  = 


Hie  following  corollary  yields  an  estimate  for  the  rate  of  convergence 
in  Theorem  4.4. 


4.5.  Corollary.  Suppose  y  £  SU **)  satisfies  the  following: 
(1)  For  each  *6  /  ,  there  exists  a  K  *  K(z)  such  that 

I  -  k/nP; 
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(2)  There  exists  a  subset  .9^  otS/1  such  that,  for  z  S-9^  and  X  with  ReX>8, 

(a)  S(t)z  6^  t  G  [0,T] 

(b)  S(t)(Al-i/)z€y,  t€[0,T] 

and  furthermore  the  constants  guaranteed  by  (1)  for  (a)  and  (b)  are  indepen¬ 
dent  of  t6  10, T]  . 

Then  under  the  hypotheses  of  Theorem  4.4,  there  exists  a  k(z)  such  that 

|fSN(t)  W(t)Jz|N  -  kU)(f)P  tG  I0'T] 

for  each  z  £  . 

The  verification  of  Corollary  4.5,  which  follows  as  a  direct  consequence 
of  the  arguments  in  support  of  Theorem  4.4,  can  be  found  in  [6]. 

The  subsequent  four  lemmas  provide  results  and  identities  which  are 
required  in  order  to  estimate  the  degree  to  which  a  rational  function  approx¬ 
imation  to  the  exponential  evaluated  at  t y,  where  J^is  the  infinitesimal  gen- 

St  JTt 

erator  of  the  semigroup  {e  :  t  0},  approximates  e  for  t  small.  With 
the  exception  of  the  final  conclusion.  Lemma  4.6  is  a  verbatim  statement  of 
Hersh  and  Kato  [15],  Lemma  2.  The  proof,  which  has  been  omitted,  can  be  found 
in  that  paper.  The  result  which  has  been  appended  to  Lemma  4.6  follows  as  an 
immediate  consequence  of  their  arguments.  Lemmas  4.7  and  4.8  comprise  a  minor 
extension  of  Lemma  3  in  [15 J.  The  proof  of  Lemma  4.7  can  be  argued  using  the 
properties  of  %  semigroups  and  their  infinitesimal  generators  (cf.  [33]). 

The  proof  of  Lemma  4.8  has  been  included.  _ 
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4.6.  Lemma.  Suppose  J?  G  G(M,B)  is  the  infinitesimal  generator  of  a 
semigroup  of  operators  and  C(z)  is  a  rational  function  of  degree  <_  0  with  no 
poles  in  {z  £  C:Re  z<0}.  Then  there  exist  positive  constants  e,  K  such  that 
|c(hj7)  |  £  K  for  all  h  with  0  <_  h  <_  e.  Moreover,  the  only  dependence  of  the 
constants  e  and  K  upon  the  operator  S'  is  reflected  in  the  choice  of  e,  where 
e  =  e(0)  . 


4.7.  Lemma.  Suppose  S~S  G(M,6)  is  the  infinitesimal  generator  of  the 

semigroup  of  operators  {e  :  t>0}.  Thei.  for  f  G  )  we  have 


j=0 


4.8.  Lemma.  Suppose 

(1)  S  £  g(M,B)  is  the  infinitesimal  generator  of  the  semigroup  of 

Sx. 

operators  (e  s  t>0}. 

(2)  C(z)  is  a  rational  function  satisfying 

(a)  |eZ-C(z)  |  =  0(  |  z|q+1)  ,  z  -*■  0  with  q>0 

(b)  deg  C(z)  <  q+1 

(c)  C<z>  has  no  poles  in  {zG  C:  Re  z<0] . 

Then  for  h  sufficiently  small,  the  operator  C(hJ)  exists  and,  moreover,  for 
f  G  @(Sq+1) ,  we  have 

|e*^hf-C(h-^jf|  <  fieeh|^-q+1f|hq+1, 

where  M  is  a  positive  constant  independent  of  _^~Gg(M,B)  . 
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Proof;  Suppose  C(z)  =  N(z)/D(z)  where  D(z)  is  a  polynomial  of  degree  p. 
Without  loss  of  generality,  we  may  assume  that  D  has  leading  coefficient  1. 
Thus  D(z)  may  be  written  as 
P 

d(z)  =  n  (z-x.) 
j=i  3 

where  by  hypothesis  (2c)  Re  X^  >  0,  j  =  l,2,...,p.  Assuming  for  the  moment 
that  (jF'-hX  exists,  we  see  that 

i  p  -1  p  -1 

D-1(h.r)  =  (  n  (_^h-X  ))  =  n  (_^h-X  ) 

j=l  3  j=l  3 


P  P 

*  n  (h-1)  (^-h^x.)-1  =  (h-1)p  n  (^r-h‘1x .)-1. 

j=i  3  j=i  3 

Now  Re  X_.  >  0,  j  =  l,2,...,p,  and  6  G(M,S)  imply 

h  *X^  <E  (X€C:Re  X>8}  C  P(_^i  ,  j  =  1,2, . . .  ,p 

for  all  h  sufficiently  small.  Hence,  (_^~-h  X^)  ,  j  =1,...,  p,  do 

indeed  exist,  as  does  C(hJ^)  =  D(h^)  ^NlhJ^)  for  all  h  sufficiently  small. 

To  prove  the  second  proposition,  we  note  that  hypothesis  (2c)  implies  that 

C(z)  is  analytic  at  z  =  0.  Therefore  hypotheses  (2a)  and  (2c)  together  imply 

that  C(z)  »  Ij=0(z3/jl)  +  zq+1Q(z)  or  Q(z)  =  (C(z)  -  jj-)z-{q+1*,  where 

Q(z)  is  analytic  near  z  =  0,  i.e.  Q  does  not  have  a  pole  at  z  «  0.  Furthermore, 

for  zG{z£C:  Re  z<0 ,  z/0},  C(z)'z  ^q+3^  is  finite  by  hypothesis  (2c)  and 

(  f  —■)  z”^q+3-^  is  finite  since  it  has  degree  less  than  zero  and  the  point 
j=0  31 

z  =  0  has  been  excluded  from  the  set  of  interest.  Therefore  we  may  conclude 
that  Q(z)  has  no  poles  in  {z  €  Cs  Re  z^0). 


If  C(z)  =  N(z)/D(z),  hypothesis  2(b)  implies 


deg  N(z)  <_  deg  D(z)  +  q  +  1. 


Therefore 


z3.  - (q+1) 


deg  Q(z)  =  deg [  (C(z)  -  \  vr)  z  1 

j=0  3 

J  n  *1 


N(z)  -  D(z) 


=  deg(- 


D(z)  z 


,q+i 


?  £ 
L  i  l 


? 

n  J  ’ 


=  deg[N(z)  -  D( z)  \  ttJ  -  deg (D(z) zq+1] 
j=0 


<  max[deg  N(z),  deg(D(z)  \  tt)]  -  (deg  D(z)  +  q  +  1) 

j=0 


=  max[deg  N(z) ,  deg  D(z)  +  q]  -  (deg  D(z)  +  q  +  1) 


deg  D(z)  +  q  +  1  -  (deg  D(z)  +  q  +  1)  =0, 

and  thus  Q(z)  satisfies  all  of  the  hypotheses  of  Lemma  4.6.  Thus,  for 
all  h  sufficiently  small  and  all  G(M,f3)  we  have 

|g(h_^)  j  <  k  for  some  K  >  0  independent  of  G(M,B)  , 


and  hence 


I C(hJT)f  -  l  -^4^-f|  =  |(h-T)q+1Q(h^)f|  =  hq+1|Q(h^q+1f| 
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Therefore, 


|e-^hf-C{h_^jf  j  <_  le-^f  -  ^  (h^  3  f |  +  |  f  (h^}  -f  -  c(h_^)f| 

j=0  j=0  3 ’ 

<  Mhq+1ehe|y*+1f|  +  khq+1|  ^q+1f| 


=  Aeh6hq+1|^q+1f 


The  estimate  of  the  bound  on  the  first  term  on  the  right-hand  side  of  the  pre¬ 
ceding  inequality  follows  from  Lemma  4.7.  r 


We  are  now  prepared  to  state  and  prove  the  primary  result  of  this  section. 
It  is  referred  to  as  the  equivalence  theorem  because  it  serves  to  characterize 
factor  convergence  for  Discrete  Approximation  Schemes  and  because  of  the  sim¬ 
ilarity  it  bears  to  the  well-known  Lax  equivalence  theorem  [20 1  •  The  reader 
is  instructed  to  note  the  similarities  which  exist  between  Theorem  4.9  to 
follow,  the  Lax  theorem  mentioned  above,  and  the  somewhat  more  general  result 
given  in  Theorem  1  of  [15].  The  key  step  in  the  arguments  supporting  the 
sufficiency  claim  in  all  three  of  these'  results  is  the  factorization  which  is 
employed  immediately  preceding  (4.11)  in  the  proof  which  is  given  below. 


4.9.  Theorem.  (The  Equivalence  Theorem)  Suppose  { , C ( z)  }  is  a 
Discrete  Approximation  Scheme  with  property  (Pi)  satisfying 

(la)  For  all  N  sufficiently  largS,  E  G(M,6)  is  the  infinitesimal 
generator  of  thei^  semigroup  of  operators  (SN(t) :  t>0)  defined  on  ZN> 

(2a)  |  Z0 1 N  0  as  N  "  for  each  z0€  where  Dj  is  a 

dense  subset  of  Z  contained  in^(fl^)  . 
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(3a)  There  exists  a  Aq €  C  with  Re  Ag  >  8  and  a  dense  subset  of  Z 
such  that  R(A0;j<^)D2  C  D  ,  ' 

and 

(lb)  |c(z)-ez|  =  0(|z|q+*)  as  z  +  0  with  q  >  0 
(2b)  deg  C(z)  <_  q+1 

(3b)  C(z)  has  no  poles  in  {z€  C:  Re  z^O}. 

Then  the  operators  C(^-Q^)  exist  for  all  N  sufficiently  large  and  factor 
stability  is  necessary  and  sufficient  for  factor  convergence. 

Proof .  The  first  proposition  follows  as  a  direct  result  of  Lemma  4.8.  The 
arguments  required  to  verify  the  necessity  part  of  the  claim  parallel  those 
employed  in  the  proof  of  necessity  in  the  Lax  equivalence  theorem  120],  and 
have  therefore  been  omitted.  A  detailed  proof  of  this  result  as  it  is  stated 
above  can  be  found  in  133] .  To  prove  sufficiency,  for  zQ  E  Z  and  k  =  0,1,2, 

. . . , pN ,  we  have 


Theorem  4.4  implies  that  the  second  term  on  the  right-hand  side  of  (4.10) 
tends  to  zero  as  N  -*■  °».  We  now  consider  the  first  term.  We  have 
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I  -V<>  lR(AO^N,q+1VcfN 


k-1 


"  I  J  c<5"'»> 5 IC,S-aS»-sH<5)  •VSM-i-j'»<V*,’q‘1Vol» 

3  =u 


(4.11) 


1  1 1 1  )s»(t“-i-j"iao!j*'»|q+1Vol» 


(4.12) 


(4.13) 


k-1 


i  H0  II  IC(E^,)-Sn(£)  lSH(tJ  IRIXoiJ^l^oU 


j=° 

k-1  & 


<  «0ajIo « 


k-1  8^ 


<  m0«m  T  =6tk-j(|)qtl|  lJ*y«y  ay  lq+VolB 


i  «0SM.e&«§>q*1|  t ja^R  ( x0  f  J3^>  1 q+i  Vo  I N 


q+1. 


<  M0HMe6V(f)q|J»'BR(X0;-arN)  |q+1|  Vol» 


1  M0AMTeST(|)q|Jar(1Ra0;JacN)  lq+1U0lz 


—  yMA  I zq  ^  r  for  *11  N  sufficiently  large. 


a  «T 

where  y  =*  M  MMTe  and  M.  is  as  was  defined  in  Lemma  4.3.  The  estimate  in 
0  A0 

(4.12)  and  the  constant  MQ  are  consequences  of  the  assumption  of  factor 
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A 

stability,  while  the  estimate  in  (4.13)  and  the  constant  M  result  from  an 
application  of  Lemma  4.8. 

Lemma  4.1  implies  that 

I  ‘R<V'a!'»,q+lV’NR(X0^,qni 

*  I  ?  K(x0,jj£)JiR(i0,j*)* -*^(»0iW>)MX0iW>q'\|B 
j=o 

j=o 

1  jo  (M  >  :e,i 1  •R<v*'»>vv<v*’ 

5  <q+1>  ■  c(n  ,T  1  ..  !  j  1  '"V^W'V^  1R(>0 ;ja/)  *0I„ 

]  €(0,1,2, . . . ,q}  (Re  Xq-B) 

-*•  0  as  N  +  ». 

Therefore,  it  follows  that 

(4.14)  |[C(^)k-SB(^nV(l0,aC)'I+1i0lN 

<  |!C(£J^)k-SB(^)]lV(i0,Jlrtq*1-R(xo.^N)q*1»„l4i)lB 

*  iK^/-v$)R<w»,q+1Vbi» 

i  I  1 1 1  ^R ^ X0 (X0  q+^ ^  *oIn 

4  I  lc<SJ*'»)k-sN«<>lR(xo'"'»|q+\%l» 
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<  (M0+H.6T)|(R(X0,^)^lVVaoffl(')<>tl]z0l(1  *  YMf1 


-+•  0  as  N  -*■  «. 


Hence 


for  each  z  €  #(R(X0?J3^) q+1)  .  But  ^(R(X0?J^) q+1)  is  a  dense  subset 

of  Z.  Therefore,  using  the  fact  thatthe  operators  lC(^Q^N)k-SN(t^)  ] ,  k  = 

0,1,2, ... ,pN,  are  uniformly  bounded  in  N  for  all  N  sufficiently  large,  we 
conclude  that,  given  e  >  0,  there  exists  an  N  »  N(e,zQ)  such  that 

I  <  e*  k  "  °'1'2 . pN 

for  all  N  >  N  and  each  zQ  G  Z,  which  implies  factor  convergence. 

D 

while  Theorem  4.9  above  yields  both  necessary  and  sufficient  condi¬ 
tions,  it  is  only  the  sufficient  conditions  that  are  of  practical  importance . 
Indeed,  the  theorem  will  be  applied  to  demonstrate  factor  convergence  for  a 
Discrete  Approximation  Scheme  satisfying  the  required  hypotheses  via  the 
generally  more  easily  verified  condition  of  factor  stability. 

The  next  corollary  provides  estimates  for  the  rate  of  factor  convergence 
for  a  factor  stable  Discrete  Approximation  Scheme  satisfying  the  hypotheses  of 


the  equivalence  theorem. 
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B 


4.15.  •  Corollary.  Suppose  tz  ,ir  , fl^N#C(z)  }  is  a  factor  stable  Discrete 
Approximation  Scheme  with  property  (PI)  which  satisfies  the  hypotheses  of 
Theorem  4.9.  Furthermore,  suppose  there  is  a  set  Sf  Q  such  that 

for  each  z  G  there  exists  a  constant  v  «•  v(z)  for  which 


for  some  p  >  0. 


Then  for  each  ZqG  for  which  Sft  j  =  0,l,2,...,q,  there 

exist  constants  =  k^tzg)  and  k2  =  k2(zQ)  depending  on  such  that 

i  VS,P  *  VS1’- 


Proof:  Let  Zq  be  as  in  the  statement  of  the  corollary  and  define 


v.(zq)  —  v  (  (j^-AqI)  ^  Zq)  j  =  0,1,2  , • . . ,q, 


v*(zJ  =  max  V  (z0) 
0< j<q  3 


Then  j^G^t ^q+1) )  implies  that  zQ  =  R(A0?af) *q+1* vQ  for  some 


vg  G  Z.  From  (4.14)  it  follows  that 


i  «vMe6T) I ir(x0i-°^) (qtllvVl,o^)lq+ll>'olN  * 


r  .  k  „  ,  ,_N, 


<  (MQ+Me61)  I  |  RO^jJa^)  j[R(X0>J3^)  T^-irNR(X0;J^)J 


>] 
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<  <M  +MeeT)  ?  |R(Xo;j^N)j||[KX0»i^N)irN-iiNR(Xo;Ja^] 
j-0 


R{X0,^)(q-:j)VolN  +  YM^1|v0lz  (f)q 


<  (MQ+Me6T) 


j=0  (Re  Xq-8) 


R(X0^(q":,)  vQ|N  +  YH^1|v0|z(|)q 


(4.16) 


0  j=0  (Re  Xq-8)^1 


|  [j^nlJ-itNJ^R(X0;J^R(X0?j^  (q'3)v0lN 


+  YMq^'v0lz(i)q 


<  (M  +Me6T)  l  - — - Tfj- 

0  j=0  (Re  XQ-B) 3+A 


+  ^  l-oiZ<S,q 


I  ^VV*R{X0** 


1  (M°+MeeT)jL  Vj<z°)(|,P + 


<  (Mrt+Me6T)M2v*(z.)(q<-l)  (  max  (Re  X  -6)  3)  (~ 
~  0  °  j  e  {1,2 . q+1)  °  N 


<«•  V6,",H5,P  +  YM»*1|volz(5,q 


=  k0(z0)(^)p  +  k2(zQ)(£)q,  for  all  N  sufficiently  large. 


where  (4.16)  follows  from  an  application  of  the  estimate  given  by  (4.2). 


Finally,  we  can  summarize  the  above  results  in  a  theorem  which  will  be 
suitable  for  application  in  the  discussions  below. 


1... 
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4.17.  Theorem.  Suppose  tzN' -°^»C{z) }  is  a  factor  stable  Discrete 
Approximation  Scheme  with  property  (PI)  satisfying  the  hypotheses  of  Theorem 
4.9.  Furthermore,  suppose  that  Sf is  a  subset  of  D  Dx  for  which 

(1)  '  For  each  z  G  there  exists  a  K  =  K(z)  such  that 

I  ^IfVV*1  z  I N  -  K  < z)  /nP 

(2)  There  exists  a  subset  5^  of  i^such  that  for  zG-S^  and  XQ  with  Re  XQ  >  B 

(a)  S(t)z€y,  tG[0,T). 

(b)  SltMX^zGy,  t€  [0,T] 

and  the  constants  guaranteed  by  (1)  for  (a)  and  (b)  are  independent  of 
t  G  [0, T] . 

Then  ^zN,irN'-^j'c^z^  is  factor  convergent  and,  moreover,  for  each 

z0€-S^n<^(j^q+1)  for  which  l\QI-JXt)  ^zQ  E  SS,  j  =  0,1,2 . .  there  exist 

constants  =  k^ (zQ)  and  k2  =  k2 (z^)  which  depend  on  zQ,  such  that 


i  ki(N)P  *  Vi’9- 


k  =  0,1,2, 


,PN. 


Proof :  Theorem  4.9  ensures  that  {ZN,itN,a^,c(z)  }  is  factor  convergent.  To 
verify  the  second  proposition,  let  zQ  be  as  in  the  statement  of  the  theorem. 
It  follows  that 


(4.18) 


l|[C(N0^)  1TN_SN(tk,1fHIzolN  +  I  ISN(tk)lrN"lrNS<tk)  ,Z0^N 


33. 


-  k0(z0)(NlP  +  k2<Z0J(Njq  +  k(20) (5,P 


V  /£)P  +  k  /£)<J 
kl(N  k2(N'  ' 


where  =  k^fZg),  and  k2  =  k2(zQ). 

The  estimates  of  the  bounds  on  the  first  and  second  terms  on  the  right 
hand  side  of  (4.181  follow  as  consequences  of  Corollaries  4.15  and  4.5,  res¬ 
pectively. 


5.  The  Pade  Approximations  and  Characterization  of  Factor  Stable/Factor 
Convergent  Discrete  Approximation  Schemes 

Adopting  the  terminology  employed  in  [12]  and  [15],  we  make  the  following 
definition, 

5.1  Definition.  We  shall  say  that  a  rational  function  r(z)  is  acceptable 

with  respect  to  the  set  (z€;C:  Re  z<0] ,  or  equivalently  a  member  of  the  class 

*Re  z<0'  if 

(5.2)  (1)  |r(z)-ez|  =  0(|z|q+1),  z  -+•  0,  q  >_  1 


(5.3)  (2)  1  r (z)  1  £  1,  z  e  (r€Cs  Re  z£0} 


Among  the  most  widely  known  classes  of  rational  function  approximations 
to  the  exponential  (rfae)  which  in  addition  provide  acceptable  subclasses 
are  the  Pad4  approximations  [10],  [37]  defined  by  the  formulae 

Pjk(z)  -H  (*)/D  k(z),  j.k  -  1,2,  ... 


where 


N  (z)  =  T  ( j+k-m) »kl  m 

j,klz/  Ln  ( j+k) !m! (k-m) !  z  ' 

IR=U 


D  (Z)  =  y  jjj _  ( 

U-i  VVZ'  l  Iml  I  1  Zl 


Ln  ( j+k) Im! ( j-m) ! 
m=u 


For  the  purpose  of  reference,  we  state  and  in  some  cases  prove  the  following 
propositions  containing  results,  properties  and  identities  relating  to  the  Pade 
approximations.  The  proofs  of  Propositions  5.8  and  5.9  may  be  found  in 
Ehle  (12l,  together  with  the  verification  of  Proposition  5.10  which  is  the 
primary  result  of  that  paper. 


5.4.  Proposition,  deg  P.  .  (z)  *  k- j ,  and 

]  ,  K 


|p.  (z)-eZ|  *  0(|zp+k+1)  ,  z  ■+  0. 

1 , K 


5.5.  Proposition. 


D  (z)  =  N  <-z)  ,  j,k  >_  0 
J  •  K  **  J 


5.6.  Proposition. 


where 


,  11 

n  k  n  a. 

P0.nU)  -  l  ST  -  IT  a-> 

k=0  k=0 


(1)  a^O,  k  ■  0,1,2,  ...,n,  all  n 
rn  .  n,... 


(2)  IJ;_0  (aj/k!)  -  1 


(3>  *k  "  ak+l'  k  “  O'1*2'---'"- 
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Proofs  Let 


<^n  -  span{l,  z,  fj-,  jj.  .... 


jtn  =  spanU,  (1+z)  , 


t  •  •  •  t 


(1+z)' 

nl 


Then  if  s  Sf"n — ►  is  the  coordinate  transformation  operator  mapping  n 

onto  cyn ,  a  simple  calculation  reveals  that  M^s  Rn+^  Rn+^,  its  matrix  repre¬ 
sentation  with  respect  to  the  bases  defined  above,  is  given  by 


M  = 
n 


1  1 
0  1 
0  0 


1_ 

21 

1 

1 


1 

1 

1_ 

3! 

4! 

•  •  • 

nl 

1 

1 

1 

1 

21 

31 

4! 

’  •  •  • 

(n-1) 1 

1 

1 

1 

1 

21 

31 

•  •  • 

(n-2) 1 

0  1 
0  0 
0 


1 

1 

0 


1_ 

2! 

1 

1 


The  inverse  of  may  be  calculated,  and  is  given  by 


1 

0 


-1 

1 


1_  ^1  1_ 

21  31  41 

-1  ± -  =1 

2!  31 


n 


(-l)n 


1_ 

n! 


(-1) 


n-1 


1 

(n-1) 1 


1  -1 

0  1 
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Upon  inspection,  it  can  be  observed  that  the  coordinate  identification 


P_  (z)G^n<-  (1.1. 1.1 . 1)  € 

u  /  n 


ji+1 


holds.  Then  if 


P0,n<2)€^ 


.  n  n 

(ao'ai' 


n.T^  _n+l 

a„>  €  R 


we  have 


We  verify  (1)  by  induction.  For  all  n,  an  =  1  ^  0,  a11  =0>^0, 


1/21 

>0,  an  ,  = 
—  n-3 

IT  ~  IT  -  SupP°Se  an-(2k-l)  -°-  Then 

n 

n 

,  , .  2k  , 

t  (-1)  an  1  1  -  0 

*n-2k 

“  an-(2k-l) 

(2k)  t  -  n-(2k-l)  (2k) !  -  ' 

and 
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n  n  +  (_i)2k  — - —  +  (-1)  (2k+1)  -r—rrr-r  >  0. 

an-(2k+l)  "  n-(2k-l)  (2k)! 


(2k+l) !  - 


The  veracity  of  (2)  follows  from 


n  a"  k  n  a" 

1  ■«  pn  (o)  =  I  kT(1  +  0)  =  ^ 

0 1  n  k”0  ^  k—O 


Finally,  for  the  verification  of  (3),  we  have 


n+1  1 


k+1  2!  3!  4! 


1  l  .  . . (n+1) -(k+1) 

+  4r  ...  +  (-D 


(rt+1- (k+1) )  ! 


1_ 

2! 


+  -1 


(n-k) .  -ak  ■ 


,n-2 


n+1  n  .  n+1  .  _  n 

X  =  0  =  a  ,  and  a.  =  1  -  a 


n-1 


n+1 


D 


Techniques  similar  to  those  employed  in  the  proof  of  Proposition  5.6 
can  be  used  to  verify  the  following  result  as  well  (cf.  [33]). 


5.7. 


Proposition  . 


ik*j> 


L<k'w1'1’,No.»u)  - 


m=0 


(k+j) 


k 

l 

m=0 


k-mtt3-l>, 
j-1  u,m 


and 


1  k  ,k-m+( j-1) N  , 

io  ^  1 
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5.8.  Proposition.  (Ehle)  If  for  some  j,  k  _>  0,  N.  (z)  has  all  of  its 

j ,  k 

zeros  in  the  open  left  half-plane,  then  for  all  m  >  j,  N  .  (z)  has  all  of  its 

—  m,k 

zeros  in  the  open  left  half-plane. 


5.9.  Proposition.  (Ehle)  For  anv  n  >  0.  if  N  .  . (z)  has  all  of  its 

- * -  —  n+l,n+l 

zeros  in  the  left  half-plane,  then  N  ^-(z)  also  has  all  of  its  zeros  in 

n,n+2 

the  left  half-plane. 


5.10.  Proposition.  (Ehle)  The  diagonal  and  first  two  subdiagonal  entries 
in  the  Padd  table  of  rfae  are  acceptable  with  respect  to  the  set 
(z€:C:  Re  z<0).  That  is, 


{Pn+l,n+l(z) {Pn+l,n(z>}’  {Pn+2,n(z)}  €  ^Re  z<0'  n  "  °'1,2' 


It  is  Ehle's  [12)  conjecture  that  these  are  the  only  entries  in  the  Pade  table 

which  are  of  class  &Re  z<Q.  Norsett  [25]  has  substantiated  this  conjecture 

in  the  case  of  the  third  and  fourth  subdiagonal  entries  in  the  table,  i.e. 

{P  ,  (z)}  and  {P  (z)}.  More  recently,  Iserles  116],  [17]  has  demonstrated 
n* jf n  H' t  #n 

that  {P  (z) }  is  not  acceptable  if  n-m  f  2(mod  4) ,  n  >  m+3. 
n,m  — 

As  is  pointed  out  in  115],  there  are  other  classes  of  rfae  in  addition  to 
the  Pade  approximations  which  have  been  investigated  with  regard  to  acceptabil¬ 
ity.  In  particular,  the  Norsett  functions  124 3  with  denominators  of  the  form 
(1  +  az)n,  a  property  desirable  for  computational  efficiency,  have  been  shown 
to  contain  an  acceptable  subclass.  However,  since  the  Pad6  rfae  yield  an 
acceptable  subclass  with  an  arbitrarily  high  degree  of  approximation,  we  are 
content  to  restrict  our  attention  to  them  alone . 
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Von  Neumann's  theory  of  spectral  sets  will  prove  a  useful  tool  in  estab¬ 
lishing  the  factor  stability  of  certain  Discrete  Approximation  Schemes  of  interest. 
The  details  of  this  theory,  and  the  proof  of  Theorem  5.12  below,  can  be  found  in 
von  Neumann's  original  work  [23],  Riesz,  Sz.-Nagy  [32]  or  Berberian  [8],  Similar 
applications  of  von  Neumann's  theory  of  spectral  sets  appear  in  [15]  and  [21]. 

Let  T  be  a  bounded  linear  transformation  on  a  Hilbert  space  H. 

5.11.  Definition.  A  set  ^  C  C  (completed  by  the  point  at  infinity)  will 
be  called  a  spectral  set  for  the  linear  transformation  T  if  (a)  it  is  closed, 

(b)  ^  2  o (T)  and  (c)  for  every  rational  function  u(z)  satisfying  the 

inequality  |u(z)  |  £  1  for  all  z£^,  we  have  that  |  |u(T)  |  |  £  1. 


5.12.  Theorem.  A  necessary  and  sufficient  condition  that  the  halfplane 
{z€Cs  Re  z<0}  be  a  spectral  set  for  the  bounded  linear  transformation  T  is  that 

Re<Tf,f>  £  0 

for  all  f£H. 


The  next  lemma,  a  modified  version  of  the  corollary  to  Theorem  6  in  [15], 
will  permit  us  to  apply  the  above  results  in  the  characterization  of  factor 
convergent  approximation  schemes.  Due  to  the  importance  of  this  lemma,  a 
detailed  version  of  the  proof  provided  in  [15]  is  included. 


5.13. 


Lemma.  Suppose 


(1>  c(z>  €  \e  ,<0 

(2)  {zGCs  Re  z£0)  is  a  spectral  set  for  T-fJl,  where  B  >  0  and  T 
is  a  bounded  linear  operator  on  a  Hilbert  space  H. 


Then  |c(^  T) |  <_  1  +  BKr/N  for  some  constant  K  which  is  independent  of  N. 


Proof:  C(z)  a  rational  function,  and  C(z)  E  8L  ...  imply  that  C(z)  must 

R6  z^u 

have  finitely  many  poles,  all  lying  in  the  right  half-plane.  Therefore  there 
exists  an  M  >  0  such  that  C(z)  and  C'(z)  are  analytic  in  {zEC:  Re  z<M>.  Now 
C(z)E  $lRe  z<0  implies  that  C(z)  is  bounded  at  00 ,  and  thus  deg  C(z)  £  0. 
Moreover,  deg  C'(z)  =  (deg  C(z))-1  implies  that  deg  C'(z)  <  0  and  C'(z)  is 
also  bounded  at  00 .  Therefore,  an  application  of  the  maximum  modulus  principle 
from  the  theory  of  functions  of  a  complex  variable  guarantees  the  existence 
of  a  K  >  0  for  which  |c'(z)  |  K  for  z  E  (z£C:  Re  z<M) .  Let 


C(z+£S)  -  C(z) 
N 


By  the  mean  value  theorem  of  differential  calculus,  we  have 


C(z+^B)  -  C(z) 

f  (2)  =  - - -  =  C'  (?)  , 

% 

N 


U-zl  1^6  ,(  =  Uz)  • 


Therefore 


sup  |f  <z)|  =  sup  |c'(?(z))| 

Re  z<0  Re  z<0 

IT  1 

for  all  N  sufficiently  large  (i.e.  ^B  <  M)  .  Consider  — f  (z)  for  N  sufficiently 

N  is.  N 

large.  It  is  a  rational  function,  and  moreover 

l^f^Cz)  |  <_  1  for  all  z  E  (zEC:  Re  z<0}  and  all  N  sufficiently  large. 

Since  {z£C:  Re  z£0)  a  spectral  set  for  (T  -SI)  implies  that  it  is  also  a 

spectral  set  for  £(T  -61),  N  *  1,2,...  (cf.  Theorem  5.12),  we  have 
N 
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lKfN(N(T  'BI)) I  -  1  or  |fN(^(T  -0I))|  <  K 
for  all  N  sufficiently  large.  This  implies  that 

((C(N  T)(  "  iC(f(T  1  |C(|  T)  -  C(|(T  -61) )  |  <  K6£ 

or 

T)  I  1  |c(^(T  -61))  I  +  ~ 

for  N  sufficiently  large.  However,  C(z)  £  «Re  z<Q  and  {zgC:  Re  z<0}  a  spec 
tral  set  for  — (T  -8l)  ,  N  =  1,2,...,  implies  that 

|C(£(T  -61) ) |  <  1  . 

Therefore, 

|c(i  T)  I  1  1  +  IT 

for  N  sufficiently  large. 

D 

5.14.  I^mma.  Suppose  that  {ZN, V^N'c(z) }  is  a  Discrete  Approximation 
Scheme  with  property  (PI)  satisfying: 

(1)  There  exists  an  inner  product  on  ZR  that  generates  a 

topology  on  ZN  equivalent  to  the  standard  ZR  inner  product  topology  for  which 


6  >  0  independent  of  Nj 


(2)  I  2 1 N  4  0  as  N  +  »  for  each  where  Dx  is  a  dense 

subset  of  Z  contained  in^(J3f)  ; 


'  -  * 
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(3)  There  exists  a  XQ  E  C  with  Re  \Q  >  6  and  D2>  a  dense  subset  of  Z 
such  that  R(A0;_q^)D2  C 

(4)  C(z)  G  n • 

Re  z<0 

Then  {Z^,i\^,srf^,c(z) }  is  factor  convergent. 


Proof:  In  the  light  of  the  remarks  in  §2,  condition  (1)  above  and 

ZfJ  finite-dimensional  are  necessary  and  sufficient  for  G(M,B)  for  all 

N  sufficiently  large.  Therefore,  if  we  can  demonstrate  that  {z„,n  ._Q^,,C(z) } 

is  factor  stable,  an  application  of  Theorem  4.9  will  yield  the  desired  result. 

Let  | | • | |  represent  the  norm  on  ZN  which  is  induced  by  the  inner 

product  [•,♦]„  and  which  obeys  the  norm  equivalence  relation  given  by 
N 


Condition  (1)  implies  that  Re [ (J# -01) z, z)  . <  0  for  all  N  sufficiently  large. 

N  N 

Thus  Theorem  .5.12  yields  that  {zGC:  Re  z^O)  is  a  spectral  set  for  the 
operators  for  all  N  sufficiently  large.  Moreover,  C(z)  E  8Re  z<Q  and 

Lemma  5.13  imply 


N  —  ^  + 


BKr 

N 


for  N  sufficiently  large.  Therefore,  for  k  =  0,1,2, ...,pN,  and  all  N  suffic¬ 
iently  large,  we  have 


i»  i  i 


til  +  ea>V 


<  .  ,8KT. 


Hence 
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|c(-J^)k|  1  ”  e^KT,  k  =  0,1,2, .. . ,pN  and  all  N  sufficiently  large, 

m 

which  implies  that  {ZN,irN,ja^,C(z)  }  is  factor  stable. 

□ 

5.15.  Lemma.  Suppose  that  {ZN,irN,_QfN,C(z) }  is  a  Discrete  Approximation 
Scheme  with  property  (PI)  satisfying 

(la)  There  exists  an  inner  product  induced  norm  | | * | | ^  on  Zy  generat¬ 
ing  an  equivalent  topology  to  the  standard  ZN  norm  topology  for  which 

II(i+kjj^)IIh  -  1  +  ar/N' 

for  all  N  sufficiently  large  with  a  >  0  independent  of  N.  Suppose  further 

that  conditions  (2) ,  (3)  and  (4)  of  Lemma  5.14  are  also  satisfied  by 

{Z„, ir„»Ja^,»c(z)  Then  {Z  .it  ,,_q/.,C(z)  }  is  factor  convergent. 

N  N  N  N  N  N 

The  proof  of  Lemma  5.15  may  be  argued  by  demonstrating  that  condition  (la) 
implies  condition  (1).  Indeed,  if  i I z I  I N  “  [z,zlN,  it  is  not  difficult  to  show 
that  (cf.  I 33J ) 

Re,j*Nz-2)B 

The  next  theorem  serves  to  characterize  a  certain  subclass  of  the  Pa ae 
approximations  and  the  factor  convergent  approximation  schemes  that  it 
generates . 

5.16.  Theorem.  Suppose  that  {Z__,it..,  qK.,C(z)  }  is  a  Discrete  Approximation 

-  N  N  N 

Scheme  with  property  (PI)  satisfying  either  condition  (1)  of  Lemma  5.14  or 

condition  (la)  of  Lemma  5.15  in  addition  to  conditions  (2)  and  (3)  of 

Lemma  5.14.  Then  if  C(z)  €  (P  (z) )  or  C(z)  £  {P  .  (z)}  or 

n+1 ,  n+i  n+i ,  n 
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C(z)  E  fP  _  (z)},  n  =  1,2,...,  where  P.  (z)  represents  the  (j,k)th  entry 

n  +  £.  f  n  j  f  k 

in  the  Pad£  table  of  rfae,  the  scheme  {Z  ,tt  , q/  ,c(z)  }  is  factor 

N  N  N 

convergent . 


Proof:  Proposition  5.10  and  Lemmas  5.14,  5.15  above. 


D 


As  we  have  seen,  the  construction  of  {Z„,tt..*^..*C(z)}  with  C(z)  E  SI 

N  N  N  Re  z<0 

together  with  the  theory  of  spectral  sets  will  enable  us  to 

characterize  large  classes  of  factor  stable  and  thereby  factor  convergent 

Discrete  Approximation  Schemes.  However,  if  c(z)  £  ![  condition 

Re  z<0 

(5.3)  deems  it  necessary  that  deg  c(z)  <_  0;  that  is,  if  C(z)  =  N(z)/0  (z)  , 
then  deg  D(z)  deg  n(z)  .  Unfortunately,  the  restriction  that  deg  C(z)  <^0 
precludes  the  investigation  of  many  approximation  schemes  comihonly  encountered 
in  practice,  and  often  with  many  highly  desirable  properties,  via  this  approach. 
In  particular,  explicit  schemes,  i.e.  those  for  which  deg  D(z)  =  0,  are  not 
acceptable  in  the  sense  of  Definition  5.1,  but  are  computationally  desirable, 
since  no  operator  inverse  need  be  calculated.  Fortunately,  however,  we  shall 
be  able  to  investigate  a  wider  class  of  approximation  schemes  than  those  con¬ 
structed  with  C(z)  E  9Re  2<q  through  the  application  of  other  techniques  to 
be  described  below.  "  " 

5.17.  Theorem.  Suppose  <VV  J3^'C (Z> }  iS  3  Discrete  Approximation  Scheme 
with  property  (PI)  satisfying  conditions  (la) ,  (2)  and  (3)  .  Then  if  C(z)  = 

PQ  k(z>,  *  ■  1*2,,,,,  {ZN,irN,ja^fCCzU  is  factor  convergent. 

Proof :  In  the  light  of  the  arguments  in  support  of  Lemmas  5.14  and 

5.15  and  the  fact  that  the  P  (z)  satisfy  conditions  (lb),  (2b)  and  (3b) 
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of  Theorem  4.9,  we  need  only  demonstrate  that  {z  -ir  ..9/  ,p  (z)),  k  = 

N  N  N  0,k 

1,2, ,  are  factor  stable  before  we  can  apply  Theorem  4.9  to  obtain  the  •  < 
desired  result. 

If  we  again  assume  the  norm  equivalence  relation  m| *|  <_  |  |  *|  lN 

m|  * |  ,  we  have  for  n  =  0,l,2,...pN  and  all  N  sufficiently  large 


45 .18)  || 


j=0  J  3=0  J 

k  a*4  k  ak 

<  (  l  ii(i  ,  1  !ieorj/V 

j-0  3  j-o  31 

k  k  ark 

<  (  l  tl  eark/N,n  =  e  N  <  earkP=  eakT, 

j-o  31 


where  (5.18)  above  follows  from  an  application  of  Proposition  5.6.  Thus 

'V* 

|p0  .  ~  eak\  n  =  0,1,2, ...  ,pN  for  all  N  sufficiently  large, 

O ,k  N  N  N  —  *v 


and  hence  ^(z)  } ,  k  =  1,2,...,  are  factor  stable. 


,  5.19.  Remark .  For  purpose  of  reference  in  the  arguments  that  follow,  the 
reader  is  requested  to  note  that  inequality  (5.18)  above  implies  that 


Up  (--anil  <  eark/N 

1  *0,KN  rT  1  *N  -  6 


as  well . 


5.20.  Lemma.  Suppose  V-a*N'Pj,k(z)  }  ls  a  Dis«ete  Approximation 
Scheme  with  property  (PI),  where  P^k(z)  -  k(z)  is  the  (j,k)th 


y'S’-T’t 
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entry  in  the  Pad6  table  of  rfae.  Then  if  condition  (la)  of  Lemma  5.15 
above  is  satisfied,  we  have  that 


-Ck'  n  =  0,1,2 . PN 


1  .  . 


for  all  N  sufficiently  large  and  k  =  0,1,2,...,  where  CR  is  independent  of 
ft,  N  and  j. 


Proof*  Proposition  5.7  implies  for  n  —  0,1 ,2, . • • *pN,  N  sufficiently  large 


lNj,k(N<*N)n"N  =  "((k+jj  IJQ(  j-1  >)P0,r»(N-fl^)‘ 

j 

<  /  J-  V  ,k-m+  { j  1 )  \  I  I  p  i—  q#  \  I  I  ) n 

-  (3fj7  V  j-l  >  1 'VmVV  Mn' 

(  .  )  m=0 

J 

<  (  1  £  (k-m+(j-l) )parm/Njn 

(k+3)  m=0  j_1 

1 

_  ,  1  V  ,k-m+(j-lh  ark/Nv  n 

1  k+T  l  (  i_i  >  e  > 

(  t3)  m=0  3  l 


=  (eark/N)n  <  earkp  =  eakT. 


Therefore,  assuming  the  norm  equivalence  relation  in  Lemma  5.14,  we  have 


|n.  k^'^N^N  —  oJ  eakT  =  cj,  n  =  0,1,..., pN,  all  N  sufficiently  large. 
3'  m 


5.21.  -  Lemma.  Suppose  ^ C z) }  is  a  Discrete  Approximation  Scheme 

with  property  (Pi)  where  P^  k(z)  ■  k(z)/D^  k(z)  is  the  (j,k)th  entry  in  the 

Pad6  table  of  rfae.  Then  if  there  exist  constants  M,g  for  which  either 
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(5.22) 


(1)  S#  E  H  (u>,8  ,M)  (cf.  12)  for  all  N  sufficiently 
N 

large  and  some  uj  >  0 


or 


(5.23)  (2)  G 

D.  .  (z) 
3»k 


we  have,  for  j  _<  K+2, 


Id  (--C/)"n|  < 

•Dj,k'N  n'  'N  - 


(M,e)  for  all  N  sufficiently  large  and  the  roots  of 
are  real. 


C ^ ,  n  =  0,1,2, 


,pN  for  all  N  sufficiently  large, 


where  C 


2 

j 


is 


independent  of  N,  n  and  k. 


Proofs  Propositions  5.8  and  5.9  imply  that  N.  ,  (z)  with  k  <  j+2  have 

3  ,K 

their  zeros  in  the  open  left  half-plane.  Indeed,  N^^z)  =  1  +  has  as  its 
only  zero  z  =  -2.  Then  if  we  adopt  the  conventions  that: 

(a)  A — » B  denotes  the  implication  that  "A  has  its  zeros  lying  in  the 
open  left  half-plane  implies  B  has  its  zeros  lying  in  the  open  left  half¬ 
plane"  justified  by  Proposition  5.8; 

(b)  A  =>B  denotes  the  same  implication  as  in  (a)  justified  by  Proposi¬ 
tion  5.9,  ' 

the  following  table  can  be  constructed  to  substantiate  the  claim. 
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n2!i(i1 

"all121 

N  <z) 

^  0, 

N.  1  (z) 

n212(Z) 
n3|2 (z) 

N1,3Iz> 

"2*3(z> 

“3*3<Zl 

I 

N  4  (Z) 

*  [ 

N  I  (Z) 

"3.5  U> 

1 

.»4T1(.Z) 

n4!2(2) 

n413u> 

N  1  (z) 

4,4 

V5U)  N4,6,z> 

"5!iIs) 

1 

n5|2(Z) 

i 

Ns!3(2) 

1 

n5!4U) 

l 

I  * 

“s.s'2’ 

1  1 

N5,7(z) 

1 

Proposition  5-5 

impl ies 

that  D^z) 

=  N.  A-z)  ,  which  in 

Jr  * 

turn  implies  that 

D  (-2)  with  i  <  k+2  has  all  of  its  zeros  in  the  open  left  half-plane.  Thus, 

D  .  (z)  with  j  <  k+2  has  all  of  its  zeros  in  the  open  right  half-plane. 

J  ik  “ 

Therefore,  for  j  _<  k+2,  it  follows  that 


|d.  (z)J  *  J  (X^'k-z>|  with  Re  xj'k  >  0,  i  »  1,2 

3,k  6 ?  i=l 

j 


and  (5k  =  n?  X?'k. 
j  1=1  1 


Mote; 

,k 
on  6  . 
3 


In  order  to  simplify  notation,  the  j,  k  superscripts  and  subscripts 
t  k 

and  Xi'  ,  i  =  l,2,...,j,  will  be  suppressed  in  the  discussion  below. 


Working  formally,  we  find 


*  i*l  1=1 

X.N 


i  l«ln  «  l<v-  i  l{|n h-r 

i=l  i=l 


Now,  Re  X^  >  0,  i  ■  1,2,  ...,j,  guarantees  that  |Arg  X^|  <  tt/2  and  Re  ~  X^  > 
6,  i  -  1,2, . . . , j ,  for  N  sufficiently  large.  Thus _q^n  £  G(M,$)  or 
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-Q^j  €  H(w,8,M)  implies  that  the  operator  inverses  in  the  preceding  inequality 
exist  for  N  sufficiently  large.  Furthermore,  in  the  case  that  (5.22)  holds, 
we  have 


(5.24) 


|6|nn  (^)n|  !-  -^)"nlN  =  l«lnn  <V|R(^WN)nlN 

i=l  i=l 


<  |«|n  n  (-)"  - <  |d|n  n  (-)nM( |~* . |-B) 

-  i.i  r  |firB|n-  i-i  r  r  1 


-n 


.  ur « „(ix  i-  fi£)‘n  -  Ur  s  m|x  rnu  -  4^) 

i=l  i=l  i 

-  |6|n(  n  lx.rn)Mj  n  (1  -  -Mr^) 

i=l  i=l  1  i 1 

1=1  1  l'  1=1  1  1 


-n,,  8r  . -n 


Br  .  -n 


Br  j  -n 


i*1."  (l  -  Tx£Tn>_PN  =  m3<  n  (1  N)P  — 

1=1  1  1=1  1 


2 

for  all  N  sufficiently  large  with  independent  of  N.  The  calculation  above 

follows  from  the  fact  that  lin^^d  -  |^r j^)  =  exp(Br/|x^|)  implies  that 

(1  -  rvri»)~N>  i  =  1,2, ...,j,  are  uniformly  bounded  in  N. 

IXJN 

When  (5.23)  holds,  the  appropriate  steps  in  (5.24)  are  replaced  by 


|5n,  ji(H)»|R(^,"|ii  <  |S"| 


N.)n 


M 


(Re  — X. 
r  i 


— -  =  |«r  n  (J)nM(|^x  l-B) 

-6) n  i=l 


where  we  have  used  the  assumption  that  X^  €  R,  i  =  1,2,. ..,3*  The  remainder 
of  the  proof  proceeds  as  in  the  previous  case. 

D 
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5.25.  Theorem.  Suppose  that  { Z„ , it , S^.. ,  P.  .(z)  }  is  a  Discrete  Approxima 
- -  N  N  N  3 

tion  Scheme  having  property  (Pi)  where  P.  (z)  =  N .  (z)/D.  .  (z)  is  the 

3 ,x  3 ,k  3  ,k 

(j,k)th  entry  in  the  Pade  table  of  rfae  and  j  <k+2.  Suppose  further  that 

{z..,ir  ,ja^,p.  ( z) }  satisfies  conditions  (la),  (2)  and  (3)  referred  to  in 

N  N  N  3 1 k 

Theorem  5.17  in  addition  to  either 

(4a)  H(w,8,M)  for  all  N  sufficiently  large  and  some  w  >  0 

N 

or 

(4b)  U€C:  D.  ( A )  =0 }  C  R. 

3  * K 

Then  the  scheme  is  factor  convergent. 


Proof:  Once  again,  we  need  only  demonstrate  that  ^ZN'1,N'-Q^J'P  j  is 

factor  stable.  Lemmas  5.20  and  5.21  imply  that 


=  |d  (-q/  ) 

1  j,k  N  N 


<  a;  i  ck, 

-3k  3 

k 

n  *  0,1,2, ...  ,pN,  for  all  N  sufficiently  large  with  Cj  independent  of  N. 


A  DAS  of  the  form  tzN'TrN'-°^,'p1  k(z)*'  k  =  O'1'2'-*-'  satisfying  conditions 
(la) ,  (2)  and  (3)  stated  above  is  factor  convergent.  Indeed,  ^(z)  is 
linear  in  z  for  each  k  and  thus  condition  (4b)  is  satisfied  as  well.  Unfortunate 
ly,  it  cannot  be  argued  that  this  is  also  the  case  for  DAS  of  the  form 
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{Z„,ir  ..Q/  ,P.  ,  (z)}  with  j  >  1  and  k  =*  j-2,  j-1,1,  j+1, . . .  .  In  fact,  it  can  be 
N  N  N  j  f  k 

demonstrated  (cf.  [33])  that  {X©:  D  (X)  =0}  consists  of  complex  conjugate 

*  t  K 

pairs  for  each  k  and  {A€C:  D,  (A)»0)  consists  of  one  real  value  and  a  complex 
conjugate  pair  for  each  k. 

Finally,  we  can  summarize  the  preceding  results  with  the  following  theorem. 


5.26.  Theorem.  Suppose  (Z„,  n„,  ja£.,P  .  .  (z)  } 
-  N  N  N  j,k 

Scheme  with  property  (Pi)  satisfying 


is  a  Discrete  Approximation 


(1)  I  z  |  -*■  0  as  N  -*•  <*>  for  each  z  (E  D,  ,  where  Dn  is  a 

’  N  N  N  1 N  1  1 

dense  subset  of  Z  contained  inS?(_g^)  ; 

(2)  There  exists  A^  €  C  with  Re  A^  >  8  and  D ,  a  dense  subset  of  z  for 
which  R(A0;O^)D2C  D1P 


and  P.  (z)  is  the  (j,k)th  entry  in  the  Pad£  table  of  rfae.  In  addition, 

3  re¬ 
consider  the  following  supplementary  hypotheses  which  may  be  satisfied  by 

{vv^N'pj,k(z)}s 

(-)  €:  H(oo,8,M)  for  all  N  sufficiently  large  and  some  w  >  0  (M,B 

independent  of  N) ,  together  with  condition  (la)  of  Theorem  5.17; 

( | )  Condition  (la)  of  Theorem  5.17; 

(0)  J2^£  G(M,8)  for  all  N  sufficiently  large  (M,6  independent  of  N) . 

Then  the  scheme  {ZM,n  „,.q£,,P .  .  (z)}  is  factor  convergent  under  the  additional 
N  N  N  j  f  K 

hypothesis  (-) ,  (|)  or  (O)  respectively  if  that  symbol  appears  in  the  (j,k)th 


position  of  Figure  5.27  below. 


5.28.  Remark .  It  is  important  to  note  that  we  cannot  make  the  claim  that  the 
results  presented  above  represent  a  complete  characterization  of  the  factor 
stable/factor  convergent  Discrete  Approximation  Schemes  constructed  with  the 
Padg  rfae.  In  fact,  numerical  results  indicate  that  stronger  conclusions  may 
indeed  be  drawn  and  that  further  investigation  is  warranted. 
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6.  Averaging  and  Finite  Difference  Discrete  Approximation  Schemes 

A  Discrete  Approximation  Scheme  ,ja/^,C(z) }  will  be  said  to  be 

N  N  N 

of  the  Averaging  and  Finite  Difference  (AFD)  type  if  it  has  been  constructed 
in  the  following  manner  (cf.  Definition  3.3).  For  each  N  =  1,2, _ _  let 


-N  _  rll(O) 

ZA  =  Span{  *N 


V0), 


li  (N) 


ni 

9n 


} 


with 


j^0)  =  (e.,0)  ,  j  =  1,2, ...,N, 


j^,k>  =  (0,xj(*)e.)  ,  k  =  1,2,, 
3  j  =  1,2, 


.  ,N 
.  ,n 


where 


T 

(0,0, • • . ,1,0, 


T  _  n 

,0)  6  R  , 


0  =  (0,0,  ...,0)  G  R  , 


n  N 

O  is  the  R  -valued  0-function  defined  on  [-r,0],  and  Xk(-)  €  1*2 ( [-r ,0)  ;R)  , 


xj<t)  =  X 

(-k|,-(k-l)§) 


(t)  =  < 


1,  t  G  [-k|,-(k-l)|) 


otherwise,  k  =  1,2,...,N. 


6.1.  Remark . 

-N 


(i)  Zft  is  an  n(N+l) -dimensional  subspace  of  Z. 
(ii)  For  k,  l  >_  1,  we  have  that 

<jC’  ■  1^M>S  ■  I  <*k<9’V  *?,e)VRnde 

-r 
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u 

■I 


xk*0)x£(0)®j®id0  “  0 


unless  k  =  l  and  j  =  i,  in  which  case 


<j*".  jC>>z  =  j  <x*m°y  *“(9lYde 

-r 

0  "(k_1)N 

=  f  x?<6)eTe.d0  =  f  d0  =  . 

J  k  D  3  J  _  N 


“kN 

(iii)  Clearly  ,  *$/k^  >  =  0  unless  k  =  0,  j  =  i,  in  which  case 

N  N  £ 

<V°\  j$(0)>  =1. 


For  each  N  =  1,  2, 


A  A  N  n  A 

(1)  Define  Z„  by  Z„  *  X  R  *  where  an  element  in  Z"  is  denoted  by 

N  N  _  N  * 


_  •  M  —  mm 

®  /  O.  •  •  •  t  civ1 )  G  Z  ,  01  ,  ^  R  f  3  =  0^1r2f.«»rN. 

U  ±  Z  N  N  3 


N  A 

The  mapping  a. :  Z,  ■*  Z„  is  defined  by 
A  A  N 


l6-2)  °A<Jn  3iNk>l  *  \'Vj,VkMI  ■  (VV“2 . V  *  2 

k=0  j=l  J  k=l 

—  i  i  i.  T  n 

where  a,  =  (a, ,a_,  ...,o  )  £  R  ,  i  =  0,1,2,...,N.  Using  the  mutual  ortho- 
i  l  2  n 

gonality  of  the  }  (cf.  Remark  6.1),  we  have  for  a,  8  £  Z^ 

N  —  —  N 


<a,|>N  =<(aN)-1a,  (oN)-1B>z 


N  n 


N  n 


<1  I  U)H™> 

X=0  j=l  J  w  k«0  j.i  j  w 


55, 


?  ?  „kAk<i*(k)  ji  00  > 


k=0  j=l 


j  j  TN  '  N  Z 


N  n 


V  „°A°  4.  V  V  «kAk<3i(k)  3100. 

j-i  ’  i  Ji  j-i  iV  *»  •  *»  ’z 

n  „  .  N  n  ,  . 

r  0o0  r  r  r  k„k 

y  a.B .  +  -  )  )  a.B  . 

)-i 3  11  “  kii  j.i  3  3 


l  \V 

k=l 


i  *  (k) 

(2)  Again  using  the  mutual  orthogonality  of  the  {J4>^  } ,  we  calculate 

'"A 

P_.  the  orthogonal  projection  of  Z  onto  the  subspace  Z^ .  Indeed,  for 
N  A 

(n,<l>>  G  Z: 


P^(n,<l)) 


N  n 


-  l  l  «*.♦>. >2ji'k’/  lj*'k)k 

k=0  j=l 

-  ^<(n»<)>)  ,  (e^  ,o>  >z  H^0) 

-(k-l)i 

=  5  (f)Te  )  (e.  ,0)  +  f  l  f  5^(0)d0)j^k 

3=1  3  3  k=i  j=i  *  3 


-kr/N 


_  N  n  f  n  _  N 

=  (n,o)  +  (0,  I  l  <7  eT  ♦(O)d0)xv(-)i.) 

Vsi  4=i  r  ;  j  *  j 

K  1  3  1  -kr/N 


-  £  J1  N  f  N  -T  N  - 

=  (n,  I  I  <7  e^(0)d0)X)c(-)e.) 

k=l  j=l  r  J  .  3  K  3 


-kr/N 
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=  (n 


.  u  J 

v=l  t 

K  1  -kr/N 


4>{0)de)x”(*)) 


/-  r:HS,  u 

(n.  I  <Ckxk(-)) 


k=l 


where 


9k 


(k-l)£ 


■!  I" 


♦<0)d6. 


-kr/N 


k  ®  1 , 2 , . . . ,N. 


.A 


A.  -1  „A 


:  Z  -*•  z„  and  (it  )  s  Z„  ■*■  Z  can  also  be 


Representations  for  the  mappings  *N 

_  _  _  _  -  A 

calculated.  For  (n,$)G  z  and  *vo’vl  'v2'  ‘ "  'vn*  ^  ZN  we  haV® 


(6.3) 


ir^(n,<l>) 


-  o^(n,  l  «<.>,  = 


-  -n  tn 


and 


^"^VV 


'V 


=  (o 


)  (Vq , Vi , . . . , v^)  =  (VQ»  I  vk^k  ^  * 


)) 


(3)  Define  J3f*j  Z*  ->■  zf  as  follows.  Let 
N  N  N 

Jt(‘;N)  :  {0,l,2,...,v}  +  {0,l,2,...,N} 

be  given  by 

£(j;N)  =  k  if  -(k-l)— )  »  j  "  0,1,2,  ...,v» 

that  is  to  say 

-Tj  €  l-fc(jjN)^,  -(£(j»N)-l)^)  ,  j  *  0,1,2, ... ,v« 
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Then  for  v  £  Z*,  v  =  »v  ,v2# . . . ,vN>  define 


(6.4)  -Qf^v  =  (L(N)v,  D(N)v) 


where  L  (N)  £  #(Z*,  Rn)  is  given  by 

v  N 

‘™i-  Vo*  .1, Vww  '  !  Dte>aev 

j=l  J  J  3=1  J  J 

-jr/N 

.  N 
A  n 

and  D(N)  £  &(Z  ,  X  R  )  is  given  (by  its  matrix  representation  with  respect 
\  ■ 

to  the  basis  for  Z^  discussed  above)  by 


N  -N 
r  r 


N+l 

0 


0 


a  =a  o  ...  o 

r  r 


N 

r  r 


®  I 


where  1^  represents  the  n*n  identity  matrix  and  ®  is  the  Kronecker  product. 
Hence 


L(N)  v, 


N,-  -  . 

?(vj-rvj) ' 


j  =  0 


j  m  l|2f . . . 


6.5.  Remark .  The  justification  for  the  characterization  of  the  schemes 
defined  above  as  averaging/finite  difference  should  now  be  clear.  Indeed,  as 
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_  A  - 

is  evidenced  in  (6.3),  £  Z  is  approximated  by  ^(n,^)  * 

-N  -N  tN.  _  A  . 

(n,4>1,<*>2 r  —  '♦jj)  €  ZN  where 


(3 


N 

r 


<^(d)de 


-jr/N 


is  the  average  value  assumed  by  $  on  the  interval  [-j^>  -(j-l)jjl.  Fur- 

A 

thermore,  (6.4)  reveals  that  for  v£  Z  ,  an  approximation  to  <f>  = 

N 

(<MO),$)e  J3^v  =  (L(N)v,  D(N)v)G  Z*  approximates^  =  (L(4»)  £  Z 

via  a  finite  difference  approximation  of  the  differentiation  operator. 


A  A  vA 

6.6.  Lemma,  {z  ,tt  ,_Qr  .C(z)  } ,  an  AFD  Discrete  Approximation  Scheme  as 
-  N  N  N 

defined  above,  will  have  property  (Pi) . 


Proof:  For  each  (n,<j>)  €  Z  we  must  demonstrate 
(*.-7>  |((^)“1irJ-i)(n^)  |z  »  |p*<n,*)-(fi,*)  lz 

=  |  (i-P^)  (n,4>)  |z  -*•  0  as  N  -*•  «. 

Since  P^  is  an  orthogonal  projection,  |p^|  £  1,  and  thus  the  operators 
{(I-P*)}  are  uniformly  bounded  in  N.  Therefore  it  suffices  to  demonstrate 
that  (6.7)  obtains  on  a  dense  subset  of  Z.  In  light  of  this  we  consider 
the  subset  if  of  Z  defined  by 

5f  -  {(n,*)£Z:*€C1(-r,0)}. 

1 

The  set  Sf  is  dense  in  Z  by  virtue  of  the  fact  that  C  (-r,0)  is  a  dense  subset 
of  L2(.-r,0),  and,  for  (n ,♦)  £  if,  the-veracity  of  (6.7)  can  be  argued  in  a 
straightforward  manner  (cf.  [33]). 

I 
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Following  Reber  [ 29] *  we  construct  the  following  weighted  inner  product 
°n  V  ^et  ^ • ,N) :  {0,1,2,...  ,N-1}  -*■  {1,2, ... ,  v}  be  given  by  k(  j  ;N)  = 
min{k>l:  -tkeUi=,j+i  Ji}'  where  Ji  "  -d-l)|)  and 


„  N 

9  •  =  g .  = 

j  1 


j  =  N 


1  +  l  I  A. i ,  j  =  0,1,2, ...,M-1. 

i=k( j;N) 


Then  for  a,  B  £Z  ,  we  define 
—  N 


C— ]N  -  “o50  +  §  Jxgk-1  “kV  1  IslI  In  =  1SL*«1n 

Noting  that  1  <  gj  <  (1  +  l\|)  *  we  have 


Nn  £  I M  lN  £  (1  +  kn\l)1/2MN, 


and  hence  the  two  norms  |*|N  and  | | • [ |N  on  ZN  are  equivalent. 


The  next  lemma  is  essentially  a  restatement  of  Reber  [29,  Lemma  6.2J  for 
the  case  of  an  autonomous  system.  The  rather  lengthy  and  technical  proof  of 
Lemma  6.8  has  been  omitted.  The  arguments  can  be  found  in  their  entirety  in  [29] 

6.8.  Lemma.  For  {Z^,Tr^^Q^^,c(z) }  an  AFD  Discrete  Approximation  Scheme  as 
defined  above,  we  have 

1,(1  +  S^l  In  £  1  +  «/n 


f 


6Q . 

for  all  N  sufficiently  large  with  a  >  0  independent  of  N. 

Recalling  Lemma  5.15,  we  note  that  Lemma  6.8  will  also  imply  the  existence 
of  a  0  for  which 

z,z]  <  8[z,z]  for  N  sufficiently  large 

where  z  =  Ug,^,  . . .  ,z^)  6  Z*,  and  $  is  independent  of  N.  A  direct  proof  of 
this  result  can  be  given,  and  can  be  found  in  [33] .  The  required  arguments  are 
in  the  same  spirit  as  those  employed  in  the  proof  of  Lemma  3.6  of  [4]. 

6.9.  '  Lemma.  For  {Z^,ir*  ,C(z)}  an  AFD  Discrete  Approximation  Scheme  as 

N  N  N 

defined  above,  we  have 


|  ia^-4^z|N  -  K(z)  a/ ft)  as  N  *  - 

for  each  z  £E  ^IQ^2)  ,  where  K(z)  =  K(  (<J>  (0)  ,♦> )  =  K(  |  4 1  ,  |  $  L  )  • 

L2 

The  proof  of  Lemma  6.9  can  be  found  in  [33].  The  arguments  are  similar  to 
those  used  in  the  proofs  of  Lemna  3.2  and  Corollary  3.1  of  [4]. 

The  next  lemma  enables  us  to  apply  Theorem  4.17  to  AFD  Discrete  Approximation 
Schemes  to  establish  estimates  for  the  rate  of  factor  convergence. 


6.10.  Lemma.  Suppose  ZQ  =  <4(0),$)€:  )  and  S(t)zQ  =  (x(t) ,xt) ,  where 

x(t)  is  the  unique  solution  to 


x(t)  -  L(xt) 


x0  * 


Then  there  exist  constants  M^,  Mj  such  that 


K  Dv  V*  *** 
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(1)  |xo|eo<M1,  a€lO,T] 

(2)  |it  |  <  m  ,  aG  [0,T]. 

a  l2-  2 

Proofs  zQ  g^(j 3^)  implies  that  $G  W2(-r,0),  with  $(0)  =  L(<|>)  ,  which  in 
turn  implies  [7]  that  x  G  (-r  ,T)  C  C1  (-r,T)  .  Therefore  *(♦)  is  a  contin¬ 
uous  function  on  the  compact  set  [-r ,T] .  Hence,  there  exists  an  such  that 
1*1  <  M,  ,  or  |*|  <  M. ,  for  o  G  10, T] . 

I' oo  —  1  1  O00  —  1 

2 

To  verify  the  second  proposition,  we  note  that  x£W2(-r,T)  implies  the 

T  ..2  2 

existence  of  an  M2  such  that  J|x(o) |  da  <_  Therefore,  for  o  G  [0,T]  we  have 


x ( o +e ) 


T 

±  |  |  x(u)  I  2du  <_  M2- 

-r 


□ 


Finally,  we  apply  the  theory  developed  in  the  preceding  two  sections 
to  AFD  approximation  schemes  in  order  to  characterize  a  class  of  factor  con¬ 
vergent  schemes  of  this  type. 

6.11.  Theorem.  Suppose  {Z*,n*,Q^*,P  (z) }  is  an  AFD  Discrete  Approxima- 

"  N  N  N  j  f  1C 

tion  Scheme  as  defined  above,  where  P  (z)  is  the  (j,k)th  entry  in  the  Pade 

J 

table  of  rfae.  Then  if  either 

(6.12)  (1)  j  =  0,  or  1,  with  k  arbitrary,  k  =  1,2,... 

or 

(6.13)  •  (2)  j  *  k ,k+l ,k+2 , ,  k  ,*  1,2,..., 

the  scheme  is  factor  convergent.  Furthermore,  for  such  j  and  k 
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l(Pj,k(K,n’»  -  ’»S(tn,lzol»  '  0a''^>  +  0a/Njtk'  ' 

n  «*  0,1,2, ... ,pN,  for  each  ZgG  3H20^+^+^)  ,  where  the  constants  in  the  0(*) 
term  necessarily  depend  on  Zg. 


Proof:  Lemmas  6.8  and  6.9  .  above,  together  with  the  choice  ^  “  °2  = 

2 

)  and  an  application  of  Theorem  5.26,  guarantee  that  the  scheme  is 
factor  convergent.  Let  us  now  consider  the  estimates  for  the  rate  of  factor 
convergence.  We  choose  and  •  Then,  for 

XQ  G  C  with  Re  Ag  >  8,  we  have  (AgI=201ZgG  Sf,  i  =  0,1,2, ...  ,j+k.  Further¬ 
more,  upon  inspection  of  the  constant  K(Zg)  in  the  statement  of  Lemma  6.9,  it  is 
immediately  seen  that  Lemma  6.10  implies  that  K(S(t)Zg),  t£  [0,T],  and 
K(S(t)  (Agl^  Zg)  ,  t  G  [0,T] ,  are  independent  of  t.  Thus  all  of  the  hypotheses 
of  Theorem  4.17  i  are  satisfied,  and  the  desired  conclusion  obtains. 

D 

6.14.,  Remark.  In  practice,  it  is  observed  that  AFD  approximation  schemes 
satisfying  conditions  weaker  than  those  stated  in  (6.12)  and  (6.13) 
factor  converge.  Two  possible  explanations  for  the  observed  behavior  of  these 
schemes  can  be  offered. 

_  (1)  The  as  defined  above  are,:’ in  actuality,  contained  in  H(u>,fJ,M) 

N 

for  some  w  >  0  and  all  N  sufficiently  large.  Unless  theJ3^ 

A 

are  negative  definite  self-adjoint  operators  on  (cf.  Kato  tisl » 

Krein  119]),  which  is  clearly  not  the  case,  this  condition  is  in 

general  difficult  to  verify.  If,  in  fact,  it  could  be  demonstrated 

thatj^*  £H(w,8,M)  for  all  N  sufficiently  large,  based  upon  an 
N 

application  of  Theorem  '  5.26  stronger  conclusions  could  be  drawn. 

(2)  Figure  5.27  does  not  represent  a  complete  characterization  of 
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factor  stable  Discrete  Approximation  Schemes  constructed  with  the 
Padd  rfae. 

Both  of  these  conjectures  remain,  at  present,  unsubstantiated. 


'7.  Spline  and  variational  Discrete  Approximation  Schemes 
For  each  N  =  1,2,...,  let 


(7.1) 


«n  f-:(o)  i  N  > 

Z  H  span(<t>N  ,<J»N  '  •••'  ' 


where  G  C  Z,  j  =  0,1,2, ...  ,kN-  Note  that  Zg  is  a  (kN+l) -dimensional 

subspace  of  Z.  Then  a  Spline/Variational  (SPV)  Discrete  Approximation  Scheme  can 
be  defined  as  follows: 


(1) 


1  f  N-N.  ,  N.-l,  .  .  N. -1 ,  .  ,  ;„kN+1  .  N.-l,  .  ,  N.-l.  .  , 

, ->N}  *  {ogZs,<  (0g)  ( -  >,  fcfg)  (-)>z}  =  (R  #<(0g)  (*),(0S)  (  * )  >z } 


where  a  is  the  canonical  isomorphism  which  associates  with  each  element  in 

V1 

Zg  its  coordinate  vector  in  R  determined  by  the  basis  defined  in  (7.1); 

S  S  “1  s 

(2)  n  :  Z  ■*  Z  and  ir  *  Z  +  z  are  given  by 
N  N  N  N 

_  *  oK  and  (rf)  1=  (a^)"1  respectively, 

N  b  N  N  b 

aQ  aJJ 

where  P^  is  the  orthogonal  projection  from  Z  onto  Zg  with  respect  to  the  Zg 
inner  product  defined  in  §2; 


(3)^. 


N  &  If 2, • • «  • 
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7.2.  Remark .  In  the  case  that  ^  }  is  an  orthogonal  basis,  we  have  for 

N. 


a,  BGzl 


N 


kN 


<a,8>  •=  Y  |i(j) I*  a  8 

N  /0  l9N  |Z“jPj 


and  for  (n,$)  £  Z 


*>.♦>  -  l  l^’l;2  «'>.♦>  .♦'i’>2?s*‘3’ 


-  I  itf*  I? 

j=0 


n  <z  »v  'zey 


kN+1 

where  e.  =  (0,0, ... ,0,1,0, ... ,0)  G  R 

1  T 

jth 


7.3.  Definition.  We  shall  say  that  an  (SPV)  Discrete  Approximation  Scheme 
has  property  (P2)  if  for  some  integer  k  >  1  we  have 


(1) 

lim 

N-*» 

L($N)  =  L(<J>) 

„n 
in  R 

(2) 

lim 

N-x« 

o 

-e- 

2 

II 

D 

-6- 

in  L2 (-r,0) 

for  all  <f>  G  Ck(-r,0),  where  $N  is  defined  by  the  relation  P?$  *  pHw (0)  ,4>) 

-•  N  N 

, .  N //N v  ,  N. 

=  (<f>  (0)  )  €  Zg. 

As  in  the  case  of  (AFD)  approximations,  we  define  a  special  inner  product 

5 

and  associated  induced  norm  on  Z^  which  generates  an  equivalent  topology  to  the 

S  -  — 

topology  generated  by  the  standard  ZN  inner  product.  For  a, 8  GZ^,  let 
glo,B]N  =  «(oN)“1o,(oN)"1S>g,g||o||^  -gta*«lN# 


where  <•,•>  is  the  inner  product  on  Z  defined  in  §2. 
9 


s  s  s 

7.4.  Lemma.  For  {z^,ir  }  an  SPV  Discrete  Approximation  Scheme  as 

defined  above  we  have 


<Pn*';,n  - 


N  *  1,2, ... , 


for  z  £  Z^  with  (5  >  0  independent  of  N. 


Proof :  Using  the  dissipativeness  of  _Q^-8l  with  respect  to  the  g  inner  product 
(cf .  §2) ,  we  have 


-  ^aV^P-JtoV1^  »  <Ja^Ca") ~XS,  (oJ> “1*> 

£>  n  s  g  s  S  g 


<  8<(o^)_1i,(Og)_1i>g  -  BjS,iJN. 


7.5.  Lemma.  For  {Z®,ir®^Q^®,C(z)  }  an  SPV  Discrete  Approximation  Scheme 

N  N  N 

with  property  (P2)  we  have 


[^Vn^lzolN  0  88  N 


for  each  €^(q^  X) ,  where  k  is  as  in  the  statement  of  Definition  7.3. 
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Proof:  |  =  (<|i  (0)  ,(j>)  €  implies  $  ^  absolutely  continuous.  Therefore 


(7.6) 


(7.7) 


=  (  |l  (<|>N>  -L(4>)  |2n  +  |D<j)N-D((.|2  )1/2  ->  0  as  N  -*  ”, 


where  the  estimate  in  (7.6)  follows  from  Lemma  3.7  and  the  one  in  (7.7)  from 
property  (P2) . 

D 


+  J 

If  we  select  D1  =  °2  "  )»  Lemmas  7.4  and  7.5  above,  together  with 

Lemma  5.14  and  Theorem  5.16,  yield  the  following  theorem  and  its  corollary. 

s  s  s 

7.8.  Theorem.  Suppose  {Z„,ir„,Q^„,C(z)  }  is  an  SPV  Discrete  Approximation 
-  N  N  N 

Scheme  with  properties  (PI)  and  (P2) .  Then  if  C(z)  €  ?lRe  z<0r  t*ie  sc*ieme 
is  factor  convergent. 

s  s  s 

1A.  Corollary.  Suppose  ,P_.  (z)}  is  an  SPV  Discrete  Approxima- 

N  N  N  3  9  ^ 

tion  Scheme  with  properties  (PI)  and  (P2)  where  P.  .  (z)  is  the  (j,k)th  entry 

3  ,K 

in  the  Pad6  table  of  rfae.  Then  if  j  =  k,  k+1  or  k+2  and  k  >  0  is  arbitrary, 
the  scheme  is  factor  convergent. 

A  (  j) 

As  a  particular  example  we  consider  the  case  of  the  ■ 

<0)  )  chosen  with  the  as  first-order  spline  functions  (cf.  [27), 

N  N  N 

[34]).  We  make  the  following  definitions. 


(1)  Let 


SN  _  ,1^(0)  2-  (0) 

Zl  =  sPan  {  eN  '  ®N  ' 


n-  (0)  1-(1) 

eN  '  eN 


1-(N) 

N 


n"  (N)  , 
eN  }' 


where 


ej  -  (0,0, ...  ,0,1,0, ...  ,0)  £r 

jih 


j~(k)  ,  k,„,  k,  , 

*N  ‘  <V0)' 

with  eN(‘)  denoting  the  scalar-valued  first-order  spline  function  on  [-r,0] 
characterized  by  the  relation 


k,-irt  . 
eN(~ )  -  6ik' 


i,k  =  0,1, . . . ,N . 


1  N-N  N 

Then  Z  =  o_Z. ,  where  a  is  the  canonical  isomorphism  defined  above. 

N  b  X  S 

(2)  The  mapping  wjjj:  Z  -*■  Zj|j  is  defined  by 

1  N  i;g 

v  =  a  p 
N  S  N 

1 Aq  , 

where  P^;  is  the  orthogonal  projection  associated  with  the  subspace  Z,  with 
N  l 

respect  to  the  Z  inner  product.  The  right  inverse  of  ir^,  (ir*)  ^ :  Z^  Z, 
g  N  N  N 

is  defined  by 


.1,-1  _  .  N  -1 

(  V  ”  (  S*  ' 
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^11  1 

(3)  The  operators  -Or.,:  2  Z„  are  given  by 

N  N  N 


Using  the  well-known  properties  of  interpolatory  splines  [34]  and  the 
fact  that  <j>N  5  P’(J>  for  Z  satisfies  a  variational  condition  by  virtue  of 

the  fact  that  is  an  orthogonal  projection,  we  have  that  the  following 
result  obtains.  The  details  of  the  proof,  which  are  omitted,  can  be  found 
in  [ 6 ] ,  Theorem  4.1. 

7.10.  Lemma.  The  SPV  Discrete  Approximation  Scheme  {Z^,u^,J3^,C(z)  } 

N  N  N 

defined  above  will  have  properties  (Pi)  and  (P2)  . 

As  a  consequence  of  Theorem  7.8  we  have 

7*11  Theorem,  if,  in  the  SPV  Discrete  Approximation  Scheme 

},  C(z)  is  chosen  from  among  those  rational  functions  in  the 
class  9Re  2<0,  then  the  scheme  is  factor  convergent. 

In  order  to  estimate  the  rate  of  factor  convergence  for  the  linear 
spline  approximation  scheme  defined  above,  we  rely  on  results  established  in 
[  6 1 .  Remark  4.1  of  that  paper  guarantees  that 

(7.12)  |  ^VV^HlN  -  0 (1/N)  as  N  -*•  - 

for  each  $6  { (<J> (0)  ,<J>) :  *£  C^-r,0)  }  D^CaT3)  ,  where  the  dependence  on  $  of  the 
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constant  K  in  the  0  term  in  (7.12)  can  be  expressed  by 

(7.13)  K  =  K($)  =  K(|||  |*|  ). 

L2 

Furthermore,  the  nature  of  the  dependence  in  (7.13)  is  such  that  Lemma 
6.10  .  guarantees  that  for  Zq€E  and  XQ  €  C  with  Re  XQ  >  (5, 

K(S(t)zQ)  |te  [0/r]  and  K(S(t)CX0I^z^|tG  [Q/r]  are  independent  of 
t  €  [0,T].  Thus,  by  analogy  to  Theorem  6.11,  we  have  the  following  result: 

7.14.  Theorem.  If,  in  the  SPV  Discrete  Approximation  Scheme 

{Z1 ,v1  .jrf1 ,P .  ,  (z)}  as  defined  above,  p.  (z)  is  the  (j,k)th  entry  in  the 
N  N  N  3  ,k  j  ,k 

Padd  table  of  rfae,  with  j  =  k,  k+1  or  k+2  and  k  >  0  is  arbitrary,  then  the 
scheme  is  factor  convergent.  Furthermore,  for  such  j 

'  0(1/,l>  *  °‘v»1+V 

n  =  0,1,2, ... ,pN,  as  N  +  ®,  for  each  z^  €^U*'j+k+3> .  The  constants  in  the 
O(-)  terms  necessarily  depend  on  zQ. 

7  J.5 .  Remark .  Further  improvement  in  the  rate  of  factor  convergence  can 
be  achieved  via  the  formulation  of  SPV  Discrete  Approximation  Schemes  employ¬ 
ing  bases  composed  of  higher-order  spline  functions.  In  particular,  if  cubic 

3  3  3 

splines  are  used,  the  SPV  Discrete  Approximation  Scheme  ,k*z>^ 

is  factor  convergent  for  j  =  k,  k+1,  k+2  and  k  >  0  arbitrary.  For  such  j 
and  k,  it  can  be  further  established  that 


11 


msauu 


l!’,j.k<X,nV’>(t",l2ol»  *  o'1'"3’  +  011/“3tk) 


n  =  0,1,2,  —  ,pN  as  N  +  «  for  each  iQ  G  ^(£^+k+5)  . 

7.16.  Remark .  Unfortunately,  it  appears  that  it  is  not  possible  to  prove 
a  result  analogous  to  Lemma  6.8  for  SPV  Discrete  Approximation  Schemes  in 
general.  That  is,  it  cannot  be  demonstrated  that 

g  |  |  |  £  1  +  ar/N  for  N  sufficiently  large  with  a  >  0  and 

independent  of  N. 

In  fact,  for  all  test  examples  considered,  the  approximation  schemes 

{Zi'4^,P0  k(z)*'  k  *  1»  2  and  k^z)^'  h  =  1,  2,  3,  exhibited 

behavior  characteristic  of  numerical  instability  when  actually  programmed  and 

tested  on  the  computer.  Indeed,  they  did  not  factor  converge.  On  the  other 

hand,  however,  it  was  observed,  again  in  all  test  examples  considered,  that 

the  Discrete  Approximation  Schemes  {z*  ,ir^J3^,P0  k*z^  w:*-th  k  L  3  and 
3  3  3 

{VV^N'P0,k<Z)}  With  k  >_  4  were  factor  convergent,  and  as  expected  with 
significantly  improved  rates  of  factor  convergence  with  increasing  k.  On 
the  basis  of  this  numerical  evidence,  we  conclude  that  many  interesting 
open  questions  remain  regarding  the  characterization  of  SPV  Discrete  Approx¬ 
imation  Schemes  employing  Pad6  rfae.  Furthermore,  in  the  light  of  the  compu¬ 
tational  desirability  of  explicit  schemes,  i.e.  those  for  which  C(z)  * 

PQ  ^(z),  k  =  1,  2,  ...,  these  questions  are  clearly  an  important  direction 


for  future  research. 
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8.  Approximation  of  the  Solutions  to  the  Non-Homoqeneous  and  Nonlinear 
Initial-Value  Problems 

We  now  turn  our  attention  to  the  construction  of  approximate  solutions  to 
the  non-homogeneous  FDE  initial-value  problem  given  by 

(8.1)  x  ( t)  =  L(xt)  +  f(t),  te  10,  T] 

(8.2)  ■  (x(0),xQ)  =  (n,$)  =  zQ 

where  the  hypotheses  satisfied  by  L,  f,  n?  and  x  have  been  specified  and  dis¬ 
cussed  in  detail  in  52.  The  procedure  by  which  this  is  achieved  is  the  extension 
of  the  results  in  S3  so  as  to  yield  approximations  to 

t 

(8.3)  z ( t)  =  S(t)z0  +  |  S (t-o) (f (a) ,0) do ,  t  6  [0,T] 

0 

We  recall  (cf.  §2)  that  the  expression  given  in  (8.3)  yields  a  solution  to 
the  FDE  initial-value  problem  (8.1),  (8.2)  via  the  equivalence  discussed  above. 

We  begin  with  several  rather  technical  definitions. 

8.4.  Definition.  For  f  6  L^O,!)  we  define  the  parameterized  family  of 
operators  T(t;f):  Z  -*•  2,  tE  [0,T]  by 

t 

T(t> f ) z  -  S(t) z  +  |  S(t-O) (f (C) ,0)d0. 

0 

8.5.  Definition.  (z)  ,D(z)  },  N  ■  1,2, ... ,  is  said  to  be  a 

Discrete  Approximation  Scheme  for  the  perturbed  problem  (DASP)  (i.e.  for 
the  non-homogeneous  initial-value  problem  (8.1) ,  (8.2)  if 
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^  ^ZN' N  =  1,2,...,  is  a  Discrete  Approximation  Scheme 
for  the  homogeneous  initial-value  problem  (3.1),  (3.2)  (cf.  Defini¬ 
tion  3.3); 

(2)  D(z)  is  a  rational  function  of  the  complex  variable  z. 

The  scheme  {zN'irjj»-fl^N*C(z)  ,D(z)  }  is  said  to  have  property  (PI)  if 
^ZN'irN''^'C(z)  *  has  ProPerty  (PI)  in  the  sense  of  Definition  3.6. 


8-6-  Definition.  For  {Z^, ttn ,  -Q^,C(z)  ,D(z)  }  a  DASP,  f  E  L2  (0rT)  and 

each  positive  integer  N,  let  the  family  of  operators  G,  (— ;f)  :  Z  z  ,  k 

K  N  N  N 

0,1,2, ... ,pN,  be  defined  recursively  via  the  relations 


Vf’"  -  1 


(8.7,  Vi.f)*"  -  c<^» 


lc  a  If  f pN t 


where  z  G  ZN  and  the  family  of  transformations 


p£:  L2(0,T)  -*■  Rn, 


k  =  1 ,2, . . . ,pN 


operating  on  f E  L2(0,T)  represent  a  discretization  of  the  function  f  on  the 
interval  [0,T].  Different  applications  of  the  schemes  to  be  developed  below 
require  various  choices  for  the  {p^}.  For  the  present  discussion,  we  define 
the  {p^}  to  be  integral  averaging  operators.  That  is,  the  p^  are  given  by 


*r 

N.  N  f 

?kf  - ;  J 


|  f (o)do,  k  •  1,2, ...,pN. 

(k-1) r/N 
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N 

Further  comments  regarding  the  selection  of  the  {p^}  are  included  in  the 
remarks  at  the  conclusion  of  §9.  The  recurrence  relation  (8.7) 
can  be  solved  to  yield 


k  =  0,1,2, . . . ,pN. 


The  operators  and  D(^_a^)  are  again  referred  to  with  the 

implicit  assumption  that  if  the  degree  of  the  polynomial  in  the  denominator 
of  c(z)  or  D(z)  is  greater  than  zero,  then  the  required  inverses  exist. 
Sufficient  conditions  for  the  existence  of  have  been  provided  in 

§4,  while  the  existence  of  D(^a^)  is  considered  in  §10  when  the  role  of  the 
rational  function  D(z)  is  discussed. 

8.8.  Definition.  A  DASP  {z„,ir..,-Q^.,C(z)  ,D(z)  }  is  said  to  be  factor 
-  N  N  N 

stable  if 

(1)  The  Discrete  Approximation  Scheme  for  the  homogeneous  initial-value 

problem,  (Z  ,ir  ,_fl£,C(S)}*  is  factor  stable  in  the  sense 
N  N  N 

of  Definition  3.4; 

-•  (2)  For  each  zS  Z,  we  have 

I[D(N-^)VVJzoIn  •”  0  as  N  +  *. 

8.9.  Remark.  For  a  factor  stable  DASP  {Z..,it„,_q£_,c(z)  ,D(z)  }.  the 

N  N  N 

strong  convergence  of  {D(~J3^)}  to  the  identity  required  by  condition  (2),  and 
an  application  of  the  Uniform  Boundedness  Principle,  imply  that  the  operators 
on  ZN,  D(^_a^l,  are  uniformly  hounded  in  N, 
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8.10.  Definition.  The  DASP  {ZN,  *N,ja^N,c  (z)  ,D(z)  }  is  said  to  be  factor 
convergent  at  zQ  £  Z  as  an  approximation  to  z (t)  as  given  by 
(8.3)  if  for  each  e  >  0,  there  exists  an  N  =  N(z0,f,c)  such  that 

lGk(f?f)Vo  "  V(tk;f)zolN  <  e'  k  -  0,1,2, ...  ,pN 


A 

for  all  N  >  N .  The  scheme  is  said  to  be  factor  convergent  if  it  is  factor 
convergent  at  each  zQ  G  Z. 

That  a  factor  convergent  DASP  does  indeed  yield  an  approximate  solution 
to  the  non-horoogeneous  or  nonlinear  FDE  initial-value  problem  is  guaranteed 
by  the  next  lemma. 

8.11.  Lemma.  Suppose  {ZN,7rN,^^,c(z)  ,D(z)  }  is  a  factor  convergent  DASP 
with  property  (PI).  Then  for  each  zQ  =  (n,<J>)  G.  Z  and  each  e  >  0  there  exists 
a  N  =  N(e,zQ)  such  that 


a  N  IT 

for  all  N  >  N,  where  z^  =  (— ; f ) u^Zq  and  x(t)  denotes  the  unique  solution  to 

the  FDE  initial-value  problem,  (8.1),  (8.2). 

The  proof  of  the  preceding  lemma,  which  is  essentially  indistinguishable 
from  the  proof  of  Lemma  3.9,  has  been  omitted. 

To  a  certain  extent,  the  techniques  and  arguments  employed  in  the  suc¬ 
ceeding  sections  parallel  Thompson's  135]  results  in  his  extension  of  the 
classical  Lax  equivalence  theorem  (cf.  [31])  to  finite  difference  approxima- 
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tions  for  non-homogeneous  and  quasi-1 inear  initial-value  problems  for  parabolic 
partial  differential  equations.  However,  unlike  the  treatment  in  [35],  we  are 
able  to  exploit  the  fact  that  for  each  fixed  t  G  [0,T]  the  non-homogeneous 
perturbation  term  which  appears  in  the  abstract  formulation  of  the  FDE  lies  in 
a  finite-dimensional  space  (cf.  [3])  and  hence  are  able  to  obtain  stronger 
results  via  simplified  arguments. 


9.  Factor  Convergence  of  Discrete  Approximation  Schemes  for  the 
Non-Homogeneous  Problem 

We  demonstrate  that  for  an  appropriately  constructed  DASP  »D(z)  }, 

factor  stability  implies  factor  convergence.  Consider  the  DASP 

{Z  . t„*J3£,,C(z) ,D(z) }.  For  each  N  *  1,2,...  and  each  t  G  [0,T],  we  define  the 
N  N  N 

following  parameterized  families  of  bounded  linear  operators  with  domain  Rn 
and  range  in  ZN>  For  n  G  Rn,  let 

(i)  T  (t)n  =  x  S(t)  (n,o) 

N  N 


(ii)  SN(t)n  = 


(iii)  c  (t)n  H 

N 


xNs(tjJ)  (n,o)  if  t  G  [jT'  <1Cm1,) f)  '  k  =  0,1,2 . PN_1 

irjser)  (n,o)  if  t  =  t 

N 

k 

c(|^N)kxN(n,°)  if  t  e  ,  k  =  0,1,2, .. .  ,PN-1 

1 

C(|ja^)PNxN(n,0)  if  t  =  T 


(iv)  DNn  =  D{Jj^)xN(n,o) 


(v)  iNn  =  tN(n,o). 
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9.1.  Lemma.  Let  {ZN«1TN*-Q^j*c<z)  *D(z)  )  be  a  factor  stable  DASP  with 
property  (PI)  for  which  (Z^ir^ja^.cU)  >  satisfies  the  hypotheses  of  Theorem 
4.9.  Then  for  each  t  £  [0,T],  we  have 

(i)  |  |TN(t)-SN(t)  |  |  -*■  0  as  N  -*•  *, 

(ii)  |  |§N(t)-C  (t)  |  |  -»■  0  as  N  -*■  «, 

(iii)  | |oN-iNl |  +  0  as  N  +  «, 


where  the  norm  in  (i) ,  (ii)  and  (iii)  above  is  that  one  which  is  generated  by 

the  uniform  operator  topology  on  _#(Rn,Z„) . 

N 

Proofs  For  t  £  [0,T]  and  each  N  =  1,2,...,  let  k..(t)  be  defined  to  be  that 
-  N 

integer  in  the  set  (0,1,2, ...  ,pN}  for  which  t  6  [k  (t)r/N,  ( (k.,(t)+l)  r)/N) . 
Then  for  each  t'€  [0,T]  and  each  n  €  ^  we  have 


(9.2)  •  |[TN(t)-SN(t)]n|N  =  |tV(t)-V(tk  (t))](n'0)|N 


<  I  (S(t)-S(t”  (t)))(n,0)  |z  ♦  0  as  N  ■*  «» 
N 


_  kN(t) 
r  v  N 


P.3)  .  |[sli(t)-cB(t))n|1,=  l!V%(t)»-='5^> 


+  0  as  H  +  »i 


^DN~1Nln'N 


|D(^ja^)irN-ffNl](T1'0)  lN  0  as  N 


(9.4) 


where  (9.2) 


follows  from  the  uniform  continuity  of  S(*)z  on  compact 


intervals  for  each  z  £  Z,  (9.3)  from  the  factor  convergence  of 
{ , Ujj , S&n ,  C  ( z) )  guaranteed  by  Theorem  4.9,  and  (9.4)  from  the  assump¬ 
tion  of  factor  stability  of  {z„,irlt,  J9^,,C(z)  ,D(z) } .  Recalling  that  strong 

N  N  N 

convergence  of  linear  operators  is  equivalent  to  uniform  convergence  if  the 
domain  of  the  operators  is  a  finite-dimensional  space,  we  obtain  the  desired 
conclusion  immediately. 

□ 

9.5.  Lemma.  Suppose  {z„,tt„/ £^.(C(z)  ,D(z)  }  is  a  factor  stable  DASf  with 
-  N  N  N 

property  (Pi)  for  which  {Z„,ii  ,,a£  .C(z)  }  satisfies  the  hypotheses  of  Theorem 

N  N  N 

4.9.  Then  for  f  6  L2(0,T),  we  have  that  the  scheme  is  factor  convergent 

at  Zg  =  0  =  (0,0) ,  the  zero  element  of  Z,  and  moreover  the  convergence  is 
uniform  in  f,  for  f  in  bounded  subsets  of  L2(0,T). 

Proof:  For  k  =  0,1,2, ... ,pN,  we  have 


(9.6)  lGk(f;£)  V“V(tk;f)elN 

=  If  .J1C(l1^)k":iD(^,,rN(5jf'0)-,rN{  S(t£-a)(f(0),0)da|N 


£ 


k  3y/N 

—  ^  C(NJa^l)  ^N^^N^r  J  f  (o)da,0) 


( j-1) r/N 


-  I  C(-J^)k"^w  (- 
N  N  N  N'r 


jr/N 


( j-1) r/N 


f  (o)da,o)  |, 


k  \ 

If  I  c(fJKl,k"j,TN(7  J  f(®)dc,°)-irN  j  S(t£-o)(f(o),o)do| 


( j  — 1) r/N 


78. 


'*'<1 

3=1 


k  ■  r  jr/N 

'JlD(^VV)('  J  f (o)do,o)  |j 

(j-1) r/N 


k  3r/N 

M  j  C(NJ3N)k'jTrN(f  (a)  '0>do 

3_1  ( j-1) r/N 


■r 


V(tk~0)(f(a)'o,dalN 


(j-1) r/N 

k  3r/N  ^  tN 


k  j*/N  tj 

~  M°l,D»'I“l|j!1  £(o)do|t|| 


.N 


i'lollvs.n  {  l,"’»lao*[‘||[cN(^-0)-itl(tJ-a)j|||fw| 


da 


£ 


itllvsll^f  |f(o,|2da)1/2  ♦  |  l|lc„(tJJ-(i)-SN(t[J-o)]|l  I,,.,!* 


£ 


/  HlVtJ-o)-Tli(tJ^)l||  (f <0]  |do 


r 


1 


where  the  constant  MQ  (guaranteed  by  the  assumption  of  factor  stability) 

it  k 

denotes  the  uniform  bound  on  the  operators  k  =  0,1,2, ...,pN  for  all 

N  sufficiently  large. 

Recalling  the  definition  of  T„(t) ,  S„(t)  and  C„,  ( t)  for  each  N  =  1,2, _ 

N  N  N 

and  each  t  €  [0,T],  it  can  be  verified  that 


| |CN(t)-SN(t)  N  1  Mq  +  Me6T 

and 

||sN(t)-TN(t)||  1  2Me6T. 


Therefore,  if  we  apply  Lemma  9.1  and  the  Dominated  Convergence  Theorem  to 
the  final  estimate  in  (9.6),  the  desired  result  follows  immediately. 
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A  straightforward  application  of  the  triangle  inequality  together  with 
Lemma  9.5  and  Theorem  4-9  yields  the  following  result. 


9.7.  Theorem.  Suppose  ,D(zl }  is  .  factor  stable  MSP 


with  property  (Pll  for  which  {z„. )  satisfies  the  hypotheses  of 
Theorem  4.9.  Then  for  f  €  Lj(0,T> ,  we  have  that  the  scheme  is  factor 
convergent  and  moreover  the  convergence  is  uniform  in  f  for  f  in  bounded 


subsets  of  L_(0,T). 


9.8. 


Remark .  The  fact  that  factor  convergence  is  uniform  in  f  for  f  in 


bounded  subsets  of  L2<0,T)  plays  an  essential  role  in  the  application  of  these 
schemes  to  the  approximate  solution  of  optimal  control  problems  for  systems 
governed  by  hereditary  systems  of  the  form  which  we  have  been  considering  (cf. 
Banks  and  Burns  [ 4  ] ,  Reber  [29]) . 

9.9.  Remark .  In  certain  applications,  choices  of  {p^},  k  =  0,1,2,. ..,pN 
other  than  the  integral  averaging  operators  employed  in  the  arguments  above 
are  more  desirable.  In  particular,  in  the  case  of  system  identification 
problems  (cf.  Banks,  Burns  and  Cliff  [  5 1 )  the  relevant  input  functions  f 
are  frequently  contained  in  the  class  of  piecewise  continuous  functions  on 
[0,T]  (PC (0 ,T) ) .  In  this  instance,  the  appropriate  choice  for  the  {p^}  is 
given  by 


(9.10)  p£f=f(t£>. 


k  =  1,2, . . . ,pN. 


While  it  is  possible  to  demonstrate  factor  convergence  for  appropriately 
constructed  DASP  employing  the  Ip.}  defined  in  (9.10),  ve  note  that  it 
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may  no  longer  be  the  case  that  convergence  is  uniform  in  f  for  f  in  bounded 
subsets  of  PC(0,T).  However,  for  problems  involving  parameter  identification 
the  convergence  obtained  for  such  {p^}  is  adequate. 

10.  Making  an  Appropriate  Choice  for  D  (z) 

For  a  DASP  {z  .it  (z)  ,D(z)  }  it  is  clear  from  the  results  presented  in 

N  N  N 

§4  that  the  rational  function  C<z)  should  be  chosen  as  an  approximation  to  the 
exponential  function  e  .  Indeed,  if  this  is  the  case,  under  the  additional 

IT  k 

hypotheses  specified  in  the  statement  of  Theorem  9.7,  C(- S&  )  yields  an  approx- 

N  N 

imation  to  S(kr/N)  and  factor  convergence  obtains.  In  this  section  we  consider 
criteria  according  to  which  the  rational  function  D(z)  can  be  selected.  In 
view  of  the  results  of  the  preceding  section,  in  addition  to  the  requirement 
that  the  operators  D(^Q^N)  exist,  at  least  for  all  N  sufficiently  large,  it  is 
necessary  that  the  factor  stability  condition  be  satisfied.  That  is,  for  each 
zQ  €:  Z  we  require  that 

iD(^,Vo-vzoiN  *  °'  N  + 

While  D(z)  =  1,  i.e.  D(^-Q^)  =  I,  the  identity  operator  on  ZN,  would  satisfy 
these  conditions,  it  has  been  observed  in  practice  that  other  satisfactory 
D(_z)  are  available  which  yield  an  ’  nproved  rate  of  factor  convergence  and 

approximate  solutions  with  enhanced  accuracy.  The  heuristic  argument  which _ 

follows  will  serve  to  motivate  these  ideas  further. 


The  basis  for  the  approximation  schemes  we  have  constructed  is  that 
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should  in  some  sense  approximate 


£ 


<S>  Vi  ♦  L 

,  N 


do. 


k-1 


In  particular. 


'  s(f’ Vi 


and 


£ 


<10.1)  I  D(i-^N),TN(pkf'0)  *  I  S(t^-o)(f<o),0)dO. 


i:  •«* 


k-l 

Recalling  that  D(^lQ^)  and  ir^  are  bounded  linear  operators,  we  rewrite  expression 
(10.1)  as 


t”  tj 

(10.2)  ’  |  D(|_Q^)nN(f(o)  ,0)do  -v-  |  S(tJ-o)  (f(o)  ,0) 

Ts-l  fck-l 


do. 


Inspection  of  (10.2)  reveals  that  D(z)  should  be  chosen  so  that  D(^_&f) 

N  N 

approximates  S(t^-o);  o  £  (t^_^,t^) ,  or  equivalently  S(t)?  tG  (0,^)  .  Con¬ 
sequently  we  consider  D(z)  of  the  form 


D(z)  =  P.  .  (Az) 

3»* 

where  once  again  P.  .  (z)  denotes  the  (j,k)th  entry  in  the  Pad4  table  of  rational 
3  ,x 

function  approximations  to  the  exponential  and  A  is  a  fixed  constant  between  0 
and  1.  The  parameter  A  included  in  the  definition  of  D(z)  serves  to  compensate 
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for  the  fact  that  for  each  N  =  1,2,...,  the  operators  { S  ( t)  :  tE  [O,^]}  are  to 

N 

be  approximated  by  the  single  operator  •  The  mean  value  theorem  from 

elementary  calculus  suggests  one  possible  choice  for  X, 


D  (— ) 


r/N 

■f  l1 


The  parameters  j  and  k  are  chosen  with  regard  to  the  requirements  that  the 

operators  P.  (X^_q/J  (a)  exist  for  all  N  sufficiently  large,  and  (b)  satisfy 

the  factor  stability  condition.  As  is  the  case  for  Discrete  Approximation 

Schemes  for  the  homogeneous  initial -value  problem,  it  is  the  behavior  of  the 

approximation  triple  (z  which  determines  the  factor  stability  properties 

N  N  N 

of  the  DASP  {VVa*N'Pif  j(z)  'Pk,£(Xz>}‘ 

The  remainder  of  this  section  is  devoted  to  characterizing  that  subclass 
of  the  Pade  table  which  under  certain  assumptions  on  {z  ,tt  ,_q£  }  yields  appro- 
priate  rational  functions  D(z) .  We  pay  particular  attention  to  the  triples 
determined  by  the  Averaging/Finite  Difference  and  Spline/Variational  state 
approximations  discussed  in  ;§6  and  §7  respectively. 


10.3.  Theorem.  Suppose  that  {zN'irN'-Q^N'Pi  j(z)}  and 

are  Tactor  stable  Discrete  Approximation  Schemes  with  property  (PI)  which  satisfy 
the  hypotheses  of  Theorem  4.9.  Then  for  X  E  [0,1]  fixed,  the  operators 

Pk  exist  for  all  N  sufficiently  large  and,  moreover,  the  DASP  given  by 

{ZN,rN,ja^,Pi, j(z) ,pk,j(Xz) }  is  factor  stable. 

Proof;  The  existence  of  the  operators  P^  £ for  all  N  sufficiently  large 
is  a  consequence  of  Lemma  4.8.  Factor  stability  can  be  demonstrated  as  follows 
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110-4>  IVt'^’Vo-V'olN 


-  ^Pk,)!(  N 1,NZ0-1,NS (  N,zO^N  +  ^S(  N>zO~zoU 


for  zQG  Z. 

A  trivial  modification  of  the  arguments  used  to  verify  sufficiency  in 
the  proof  of  Theorem  4.9  yields  that  the  first  term  on  the  right-hand  side  of 
(10.4)  tends  to  zero  as  N  -*•  00 ,  while  the  fact  that  {s(t):  t>0}  is  a  ^ 
semigroup  of  operators  on  2  implies  that  the  second  term  tends  to  zero  as  N  +  « 
as  well. 

D 

Theorem  10.3  applied  in  conjunction  with  the  results  of  §5 
provides  a  rich  class  of  appropriate  rational  functions  D(z) .  Indeed,  for  a 
given  approximation  triple  { ) ,  §5  serves  to  characterize 
those  entries  in  the  Pad6  table  which,  when  selected  for  C(z),  yield  a  factor 
convergent  Discrete  Approximation  Scheme  for  the  homogeneous  problem.  Theorem 
10.3  further  reveals  that  any  choice  appropriate  for  C(z)  is  appropriate  for 
D(z)  as  well,  and  thereby  gives  rise  to  a  factor  convergent  DASP. 

While  Theorem  10.3  .  assures  us  that  for  a  given  approximation  triple 
{Z  .ir  ,ja£  }  satisfying  certain  basic  hypotheses  the  set  of  factor  stable  DASP 
of  the  form  {Z  ,ir  ,_q£_,P,  .  (z),P  (Xz)}  is  non-empty,  we  are  fortunate  in  that 

W  N  N  1  f  J  K  f  X, 

a  still  broader  characterization  is  possible.  Furthermore,  these  results  will 
be  directly  applicable  to  the  Averaging/Finite  Difference  and  Spline/Variational 
approximation  triples  which  have  been  discussed  earlier. 
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10*5.  Theorem.  Suppose  that  (z^, j(z)}  is  a  factor  stable  Discrete 
Approximation  Scheme  with  property  (PI)  which  satisfies  the  hypotheses  in  the 
statement  of  Theorem  4.9.  Suppose  further  that  there  exists  a  constant  K  >  0 
independent  of  N  such  that 


'10.6)  .  I (I  *  f*£>  l„  i  * 


for  all  N  sufficiently  large.  Then  for  each  k,Z  >  0  with  k  £  1+2  and  each 
A  €  [0,1]  we  have  that  the  operators  Pfc  Z(~S^N)  exist  for  all  N  sufficiently 
large  and,  moreover,  the  DASP  given  by  {Z  ,ir  ,_Q/,  P.  .  (z),P,  (Az) }  is  factor 

N  N  N  1  /  3  K  t  )L 

stable. 


The  proof  of  Theorem  10.5  can  be  argued  in  much  the  same  manner  as  were 
the  proofs  of  Lemma  4.8  and  Theorem  4.9  (cf.  [33])  . 

As  a  consequence  of  this  theorem,  one  has  that  if 

.(z)}  is  a  Discrete  Approximation  Scheme  satisfying  the  required 
N  N  N  1 ,  ] 

hypotheses,  then  for  each  k  >  0  and  A  €  [0,1]  the  DASP  given  by 

{Z.,K„^„,P.  .( z)  ,Prt  .( Az)  }  is  factor  stable.  That  is  to  say,  we  may  choose 

NNNl,3^’K.  - 

D(z)  from  among  those  entries  in  the  Pad4  table  for  which  no  operator  inverse 
need  be  calculated  in  the  computation  of  the  operators  . 

That  condition  (10.6)  is  satisfied  by  the  Averaging/Finite  Difference 
approximation  triple  is  an  immediate  consequence  of  Lemma  6.8.  That  the 
condition  also  obtains  for  the  linear  Spline/Variational  approximation  triple  is 
the  conclusion  of  the  next  theorem. 


10.7.  Theorem.  For  {Z^,tt*  as  defined  in  57,  we  have 

N  N  N 


(I  + 


ESS* 


where  M'*’  is  independent  of  N. 
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lartr«»,Oi:  =  |(L*”,D*")|; 


l*Tn  +  NN|2 

R  2 


The  Schmidt  inequality  (cf.  Schultz  £34] )  yields  the  following  bound  for  | D4>N | 


0  N  -( j-1) r/N 

| D4>N 1 2  =  f  I D4>N (a)  1 2da  =  l  I  |d«|>N(o)  |  2do 
2  -r  j=1  -jr/M 


- (i-1) r/N 

<  I  12 (— ) 2  I  UN(a)  |2da  =  12(Vj*N|2 

j=i  r  L . 


N.2. ,Ni2 


-jr/N 


<  12(f)2[UN(0)|2n+  UN|2  1  =  12(f)"  \*X 


N,  2  i  ?N  i  2 


Consequently  for  -T  € l-r,0]  it  follows  that 


0  u 

|<|>N(-t)|2  =  |*N(0)  -  |  D<J.N(CT)da|2  <_  2|«|>N(0)  I2  +  2  t  |  |  D<f>N  (a)  1 2da 


<  2|*NC0)|2  +  2t|d$N|2  <  2  |  <(>N<0)  | 2  +  24r(VUN| 


<  K^2!  (<|>N(0)  ,♦**)  I2  =  k1n2|*n|2 


where  is  a  positive  constant  independent  of  N.  This  in  turn  implies 


|i/|2  1  2|  l  */(-o|2  +  2  |f  D<e)4>Nce)de |: 

R  j-1  7  3  ir 

<a(  ^  |AjIUH(-Tj)|)2  +  2|D|22UH|22 


£2v  t  |  A  J2UM(-V|2  +  2|D|J 
j-1  3  J  2 


2  |J«|2 
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<  (2VK,  I  | A .12)N2|$B|=  +  2|d|*  U"!2 


i  vVi*. 


where  K2  is  a  positive  constant  independent  of  N.  Therefore,  we  have 


|^|2  <  |L^|2n  +  |  D<JiN  | 2  <  K/lfl2  +  12r-V|^|2 


=  kn2|$n|2  , 

where  K  is  a  positive  constant  independent  of  N,  and  hence 


n'n 


=  0(N) 


10-.9 .  Remark .  The  results  of  Theorem  10.7  are  easily  generalized  and 

extended  to  apply  to  approximations  employing  spline  bases  of  arbitrarily  high 
order  (the  relevant  constants  will  of  course  depend  upon  the  order  of  the 
spline  basis  chosen) .  In  particular,  this  includes  the  cubic  Spline/Variational 
triple  discussed  in  §7. 

It  is  interesting  to  note  that  for  a  given  approximation  triple 

(Z  .  tt  ,j^7 }  several  standard  time-differencing  numerical  techniques  for  ordinary 
N  N  N 

differential  equations  determine  DASP  of  the  form  f2jj»V"l*N'Pi  ^(z),Pk  ^(Az)} 
when  applied  to  the  approximating  ODE  system  in  ZN  given  by 

(10.10)  zN(t)  «  J3f^zN(t)  +  irN(f(t),0),  t€  (0 ,TJ 

V0>  “  Vo  “  Vn'*) 


(10.11) 


We  conclude  this  section  with  two  examples  which  serve  to  illustrate  these  ideas. 


10.12.  Example  (Trapezoidal  Approximation).  For  a  given  approximation 

triple  {2  ,ir  consider  the  approximating  ODE  system  (10.10),  (10.11) 

N  N  N 

in  its  equivalent  integral  equation  formulation  given  by 

t  t 

z  (t)  =  z„(°)  =  -90M(a)do  +  tt  (f(o),0)do,  t€  [0  ,T) . 

N  N  J  N  N  J  N 

0  0 


Recalling  that  t^  =  kr/N,  k  =  0,1,2, .. .,pN,  it  follows  that 

£  £ 

(10.13)  zN(t”)  =  zN(t^_1)  +  ja^zN(a)da  +  j  »N<f (a)  ,o)do. 


k-1 


Tc-l 

k  =  0,1,2, .. . ,pN. 


If  we  approximate  the  first  integral  on  the  right-hand  side  of  (10.13)  via 
the  trapezoidal  rule  for  numerical  integration,  we  have 


y# 


* 


yvi 


)  + 


r 

2N 


NZN(tk-l) 


+-^NZN(tk,] 


f 

'  N 


ir  (f  (o)  ,0)  do . 

N 


Tc-l 


or 


.  N 


(10.14)  (I  -  §^>zN<t£)  *  (I  + 


2NJy  ZN(tk- 


,)  + 


r  .N  fk 

Vi 


f  (a)do,o) 


y.  _  1 

Recalling  that G  G(M,$)  implies  the  operator  (I  -  —33^)  exists  for  all  N 

N 

sufficiently  large,  we  solve  (10.14)  for  z^t^)  and  find 


V<>  '  (I  -  *  Slt  - 


90  •. 

Consequently,  an  approximation  scheme  can  be  defined  and  is  given  by  the  following 
relations : 

0 

z..  =  "  z„, 


"  (1  -  W* 


,)  (I  + 


r  .  k-1 
2N^  ZN 


N(I  "  2N'Q^J) 


R  =  1,2, .. . ,PN. 


Recalling  the  definition  of  the  family  of  approximate  solution  operators  for 

the  non-homogeneous  initial-value  problem,  determined  by  a  given 

DASP  {Z  ,ir  , ,C(z)  ,D(z)  }  for  each  N  =  1,2,...,  it  can  be  verified  that 
N  N  N 


■  Gk(f,£,vo' 


k  =  0,1,2, . . . , pN , 


T  r  pN 

where  for  each  N  =  1,2,...,  (G^t— ;f) }^=q  denotes  the  family  of  approximate  solu¬ 
tion  operators  corresponding  to  the  DASP  given  by  {Z„,w  , J3^,,P,  , (z) ,p_  „(^z)}. 

N  N  N  1,1  1,02 

We  note  that  when  {z  ,x  ,_Q^}  j.s  an  Averaging/Finite  Difference  approximation 

N  N  N 

triple,  the  method  which  has  just  been  discussed,  and  thereby  the  DASP 
AAAI 

^ZN,1IN,'-C^N'I>1  ^(z),?^  0^2*^  '*'S  anal°9ous  to  the  well-known  Crank-Nicolson 
approximation  commonly  employed  in  the  numerical  solution  of  parabolic  partial 
differential  equations  [22]. 


10.15.  Example  (The  Improved  Euler  Approximation) .  For  a  given  approximation 

triple  {Z^,^,.^}  it  is  once  again  convenient  to  consider  the  approximating  ODE 

system  (10.11),  (10.12)  in  its  equivalent  integral  equation  form  on  the 
N  N 

intervals  [t^^t^],  k  ■  l,2,...,pN  given  by  the  expression  in  (10.13): 


"N 


(tk- 


+ 


(c)dc  + 


*N(f (o) ,0)da. 


91. 


The  improved  Euler  approximation  formulae  [14]  with  step  size  r/N  are  an  Euler 


predictors 


(10.16) 


*k  k-1  r  k-1  r  ,N  f  .  . 

ZN  =  ZN  +  N~TJZN  +  iiVr  I  f(°,d°'0) 

t,N 

k-1 


followed  by  a  trapezoidal  corrector: 


(10.17)  .  = 


N  =  S"1  +  +  SVf  {  f(o>do'0> 

.  N 


When  combined,  (10.16)  and  (10.17)  lead  to  the  approximation  scheme  given 
by  the  relations 


ZN  “  Vo 


U0.18)  <  -  (I  +  ♦  fd  ♦  *„(#■<» 


A  comparison  of  expressions  (10.18)  and  (8.7)  reveals  that 


k  „IE,r  ,, 

ZN  _  Gk  N?f)7rNZ0' 


k  =  0,1,2, . . . , pN 


for  each  N  =  1,2,...,  where  (G*E  (j^;  f)  } denotes  the  family  of  approximate 

solution  operators  determined  by  the  DASP  (Z„, P.  _(z),P„  ,  (^z)}. 

N  N  N  U  f  &  U  j  L  4 

Several  other  numerical  integration  techniques  for  ordinary  differential 
equations  commonly  encountered  in  practice  correspond  to  DASP  of  the  form 
^ZN'irN,'®^'Pi  j^,Pk  Z  ^  ^z) } .  In  particular,  the  explicit  Euler  or  forward 


PP*rrs»Mr''r 


-^wr- 
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difference  method  gives  rise  to  the  DASP  tz„,ir  ..q/  ,Prt  ,(z),l},  while  the 

N  N  N  U ,  1 

implicit  Euler  or  backward  difference  method  determines  the  DASP 
*ZN,TrN'  -%'Pl,0(z)  'Pl,0(z)  ** 

10.19.  Remark.  Examples  10.12  and  10.15  above  provide  a  natural  link 
between  the  ideas  of  the  present  investigation  and  the  approximation  framework 
developed  in  [3]  and  [6].  Indeed,  for  a  given  approximation  triple 
satisfying  hypotheses  similar  to  those  given  in  the  statement  of  Theorem  4.9, 
the  latter  treatments  demonstrate  the  convergence  to  the  expression  given  in 
(8.3)  of  the  classical  variation  of  parameters  solution  to  the  initial- 

value  problem  (10.10),  (10.11).  When  actually  applied  in  practice,  the 
desired  approximating  solution  is  obtained  via  the  application  of  standard 
numerical  integration  techniques  for  ordinary  differential  equations  to  (10.10), 
(10.11).  If  the  numerical  integration  scheme  employed  is  among  those  discussed 
in  the  examples  above  (and  others  not  presented)  and  the  time  step  for  the 
method  is  chosen  as  r/N,  the  two  formulations  become  equivalent. 

11.  Analysis  of  Numerical  Results 

We  present  here  computational  results  derived  from  the  application  of  approx¬ 
imation  schemes  included  in  the  framework  developed  above  to  several  hereditary 
systems  of  the  form  discussed  in  §2.  The  numerical  results  which  follow  were 
obtained  via  a  software  package  developed  by  the  author  and  implemented  in  APL 
on  the  IBM  360/67  at  Brown  University.  All  of  the  calculations  which  follow  were 
performed  in  a  330K-byte  workspace  which  was  sufficient  to  generate  approximate 
solutions  with  values  of  N  up  to  96  in  the  case  r  =  1,  n  =  1  and  N  *  32  in  the 
cases  r  ■  1,  n  ■  2  and  r  -  1,  n  ■  3.  A  computationally  efficient  software 
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package  based  on  the  approximation  framework  discussed  above,  which  includes 
methods  utilizing  the  Averaging/Finite  Difference  and  Spline/Variational  state 
variable  approximations,  is  currently  under  development. 

In  addition  to  the  example  which  follows,  we  have  tested  our  approximation 
schemes  on  several  other  hereditary  systems  with  a  variety  of  characteristics 
(cf.  [33]).  These  examples  werealso  used  to  test  the  methods 
developed  in  [ 2  ] ,  [4  ]  and  [6  ].  Hence,  they'  can  serve  as  a  basis  for  a 
preliminary  comparison  of  the  two  approximation  techniques.  It  is  interesting 
to  observe  that  in  many  instances,  for  the  same  state  variable  approximation, 
the  results  we  obtain  via  a  Discrete  Approximation  Scheme  constructed  with  a 
second-order  convergent  rational  function  approximation  to  the  exponential 
compare  favorably  with  the  corresponding  results  in  [ 2  ]  and  [6  ]  computed 
with  a  fourth-order  Runge-Kutta  integration  of  the  approximating  ODE  with  step 
size  chosen  independently  of  the  state  variable  approximation. 

When  considering  the  rates  of  convergence  in  our  test  examples,  we 
would  not,  in  general,  expect  to  observe  those  rates  theoretically  predicted 
by  the  results  discussed  in  §4.  Indeed,  those  estimates  pertain  to 
the  homogeneous  problem  exclusively  on  a  restricted  class  of  initial  data. 
However,  the  predicted  rates  appear  to  be  in  some  sense  indicative,  if  not 


conservative,  estimates  of  the  qualitative  behavior  observed  experimentally  in 
many  of  the  test  examples  (both  homogeneous  and  non-homogeneous  with  arbitrary 


initial  data)  which  we  have  studied. 

N 

In  the  tables  which  follow,  the  symbol  denotes  the  absolute 

difference  between  the  exact  solution  x  to  the  FDE  initial-value 


problem  and  the  approximate  solution  computed  via  the  Discrete  Approximation 
Scheme  for  the  non-homogeneous  initial-value  problem 


(11.1) 
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where  P  (z)  denotes  the  (u,v)th  entry  in  the  Pade  table  of  rational  function 
V* .  v 

approximations  to  the  exponential  and  the  superscript  *  may  take  on  the  values 

A,  1  or  3  depending  on  whether  the  state  variable  approximation  is  of  the 

Averaging/Finite  Difference/  linear  Spline/Variational  or  cubic  Spline/Variational 

type,  respectively.  The  parameter  X  has  been  fixed  at  1/2  throughout.  In  the 

discussion  below  we  also,  on  occasion,  denote  the  DASP  (11.1)  by  the  shorthand 

notation  {*,N,i,  j,k,£) .  Finally,  recalling  that  |p.  . (z)-eZ|  =  0(z1+^+1)  as  z  -*•  0, 

1 1 J 

we  define  the  quantity  q  =  i+j  as  the  index  of  the  approximation  scheme  {* ,N,i, j ,k, fc} . 

11.2.  Example  (Banks  and  Kappel  [6  ]»  Example  1).  Consider  the  scalar, 
second-order,  non-homogeneous  initial-value  problem 

ii(t)  +  u  ( t)  +  u(t-l)  =  10, 

u{0)  =  cos  0,  u(0)  =  -sin  0,  -1  <  6  <  0 


in  its  equivalent  formulation  as  a  2x2  first-order  system  in  the  form  of  (2.1),  (2.2), 


x(t)  =  [°  _J)x(t)  +  [_J  °3x(t-l)  +  l^], 

x(0)  *  (1,0)T,  xQ (0)  =  (cos  0,  -sin  9) T, 


where  =  u  and  x?  =  u. 

The  solution  on  the  interval  (0,2)  can  be  calculated  by  the  method  of 
steps  [113  and  is  given  by 

xx(t)  -  w(t)  =  -9  -  sin  1  +  lOt  +  (10  +  .5  sin  1  -  .5  cos  l)e_t 

+  . 5(sin  1  -  cos  l)sin  t  +  .5(sin  1  +  cos  l)cos  t,  t€  [0,11 


-  -  -fcl- 
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xx(t)  -  w(t)  -  29  -  2  sin  1  +  cos  1  +  {19  +  sin  1) (t-1)  -  5(t-l)2 

+  (29.5  +  1.5  sin  1  -  cos  l)e"(t"1)  +  (10  +  .5  sin  1  -  .5  cos  l)e“(t"1> 
+  .5(sin  1  -  l)cos(t-l)  +  .5(1  -  cos  l)sin(t-l)  t  €r  [1,2] 


x2(t)  =  x^t)  . 


The  numerical  results  for  this  example  are  exhibited  in  Tables  11.3 

and  11.4.  Based  upon  this  evidence,  we  make  the  following  observations. 

Averaging/Finite  Difference  approximations  in  an  explicit  scheme  of  index  2, 

{A, N, 0,2, 0,1),  effectively  yield  0(1/N^”^)  convergence,  where  6  is  a  positive 

number  strictly  less  than  1.  Although  the  rate  of  convergence  remains  unchanged, 

approximate  solutions  generated  by  the  explicit  scheme  of  index  1,  {A, N, 0,1, 0,0} 

for  each  N,  were  in  general  less  accurate  than  the  corresponding  results  for 

the  index-2  scheme.  Little  if  any  improvement  is  gained  through  the  application 

2 

of  AFD  schemes  with  index  q  greater  than  2.  Convergence  like  0(1/N  )  as  N  +  • 

is  achieved  by  the  diagonal  implicit/explicit  scheme  {1,N,1,1,1,0}  of  index  2 

constructed  with  a  linear  Spline/Variational  state  approximation.  Accuracy  is 

enhanced  when  diagonal  schemes  having  index  greater  than  2  are  employed.  For 

the  index-4  scheme,  {3, N, 2, 2, 2,0},  with  cubic  Spline/Variational  state  approx- 
2 

imations,  0(1/N  )  convergence  is  observed.  Once  again  increased  accuracy  is 
obtained  if  a  scheme  having  a  higher  index  is  employed.  Extremely  accurate 
results  obtained  with  cubic-spline-based  methods  for  relatively  small  values 
of  N  make  the  characterization  of  convergence  rates  difficult.  Indeed,  the 
actual  approximation  error  is  most  likely  masked  by  the  influx  of  error  from 

l 

other  sources,  i.e.  machine  roundoff  and  numerical  quadratures.  _ 


11.5.  Remarks .  Evidence  provided  by  our  numerical  study  indicates  that  certain 
trade-offs  exist  in  choosing  between  an  AFD  and  SPV  approximation  scheme.  While 
in  most  cases,  SPV  methods  yielded  superior  results,  it  has  been  observed  (cf. 

[6],  Example  4)  that  when  the  initial  data  lies  in  the  subspaces  of  Z,  (Z^)  (cf. 
56) ,  defined  in  the  construction  of  the  Averaging/Finite  Difference  approximations, 
the  AFD  methods  provide  results  superior  to  those  of  spline-based  approximation 
schemes . 

In  addition,  as  one  might  expect,  a  price  must  be  paid  for  the  increased 
accuracy  and  rapidity  of  convergence  yielded  by  the  cubic  spline  methods. 

Due  in  part  to  the  wider  bandwidth  of  the  matrices  generated,  these  schemes 
tend  to  be  more  difficult  to  program,  take  longer  to  execute  and  have  larger 
storage  requirements  than  either  the  Averaging/Finite  Difference  or  linear 
Spline/Variational  approximations.  Moreover,  as  is  the  case  in  any  numerical 
approximation  algorithm,  it  is  desirable  to  maintain  a  uniform  order  of  approx¬ 
imation  throughout  all  phases  of  the  computation.  The  cubic  spline  state 

2 

approximations  with  a  theoretically  predicted  convergence  rate  of  0(1/N  ) 
as  N  •  will  therefore  perform  best  in  a  scheme  with  a  relatively  high  index. 
Unfortunately,  in  the  case  of  spline-based  approximations  we  are  unable  to 
guarantee  factor  convergence  of  explicit  methods.  Thus,  for  a  factor  con¬ 
vergent  Discrete  Approximation  Scheme  of  high  index  employing  cubic  spline 
state  approximations,  it  is  necessary  to  invert  a  matrix  which  is  a  high- 
degree  polynomial  in  the  matrix  In  general  r  this  tends  to  be  a  numerically 
ill-conditioned  procedure  and  may  require  the  use  of  higher  precision  arithmetic. 


12.  Concluding  Remarks 

He  have  constructed  an  abstract  approximation  framework  which  can  be  applied 
to  FDE  initial-value  problems  of  the  type  discussed  in  S2.  He  have  detailed 
readily  verifiable  conditions  which  if  satisfied  guarantee  convergence  to  the 
solution  of  the  initial-value  problem,  ihe  schemes  proposed,  and  the  abstract 
framework  in  general,  represent  an  alternative  to  related  approximation  packages 
for  FDE  suggested  by  Banks  and  Bums  [3],  [4]  and  Banks  and  Kappel  [6],  Further¬ 
more,  in  the  case  of  an  autonomous  linear  system,  the  methods  developed  here  are 
an  extension  and  generalization  of  the  ideas  discussed  by  Reber  (29] . 

Hi thin  the  framework  itself,  there  is  a  great  deal  of  freedom  in  the  actual 
selection  of  a  particular  convergent  approximation  scheme.  Moreover,  based  on 
the  evidence  discussed  in  the  previous  section,  one  can  conclude  that  the  appro¬ 
priate  choice  of  parameters  which  determine  the  optimal  method  to  apply  depends 
heavily  upon  the  characteristics  of  the  initial-value  problem  under  consideration. 

The  numerical  results  for  the  test  examples  suggest  that  the  factor  con¬ 
vergence  properties  of  a  particular  method  depend  rather  heavily  on  the  interrela¬ 
tion  between  the  order  of  the  Btate  approximation  employed  and  the  degree  to 
which  the  rational  function  component  of  the  scheme  approximates  the  exponential 
function.  In  fact,  it  is  apparent  that  a  deeper  understanding  of  this  interdepen¬ 
dence  would  provide  valuable  insight  which  could  lead  to  the  solution  of  many  of 
the* unanswered  questions  posed  throughout  this  paper. 

The  approximation  framework  developed  in  this  investigation  has  also  been 
applied  to  certain  classes  of  quasi-linear  FDE  initial-value  problems  (cf.  (331), 
and  has  been  expanded  so  as  to  become  part  of  a  package  yielding  approximate  solu¬ 
tions  . to  the  optimal  control  and  parameter  identification  problems  for  systems 
governed  by  retarded  functional  differential  equations  of  the  type  we  have 
considered  (cf.  [2],  [3],  [4],  [5],  [29]). 
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